Apache Spark 4.2 is out, and it adds vector primitives to Spark SQL: distance and…
This is a dev post classified by Jev as Databases (a launch), kept by the Dev Radar because it carries real work, not commentary.
Apache Spark 4.2 is out, and it adds vector primitives to Spark SQL: distance and similarity functions, normalization, aggregation, and NEAREST BY (a top-K ranking join). Retrieval and recommendations run in SQL at Spark scale, next to your data. 🔗 Download Spark 4.2: https://spark.apache.org/downloads.html #ApacheSpark #VectorSearch #SparkSQL
Posted by Apache Spark (44.6k followers) 15 h ago · 43 likes · 3.4k views · view the original post on X. Kept by the Dev Radar as Databases. Tools mentioned: Downloads.
More dev work like this
- Enterprise data can contain the answers you need, but it's often difficult to query… — @freeCodeCamp
- Nathan: — @benswerd
- Snowflake Adaptive Compute predicts each query’s performance curve before execution. — @Snowflake
- Reporting across SQL, spreadsheets, and APIs shouldn’t require a custom BI build. — @DanKornas
- Zero-Copy Interactive lets Interactive warehouses query your existing standard Snowflake… — @Snowflake
- Stop sending your coding agent into vector-search docs without a map. — @DanKornas
- Text classification in MotherDuck just got ~50x faster at ~1% of the cost. — @motherduck
- Weighing up indexers? We put up a page that compares Envio with the alternatives. — @envio_indexer
Every post is read and classified by Jev (TypeSafe): what it is, which market it belongs to, and whether the link is a real tool. 20.7k posts from 4.9k X accounts over the last 21 days, 2.4k tools, 12 markets. Collected every 5 minutes, fully re-ranked every hour — last update 2026-09-22 08:21 UTC. Full method.