📢 Spark NLP 7.0.0: Welcome, Apache Spark 4! New support for Spark 4.x alongside Spark 3.x Spark NLP is taking a major step forward with 7.0.0: support for Apache Spark 4.x and Scala 2.13, while preserving the Spark 3.x / Scala 2.12 line. This is more than a version-number update.
📢 Spark NLP 6.4.2: BM25 Retrieval, SaT Sentence Detection, and Model Conversion Workflows Spark NLP 6.4.2 is a feature and reliability release focused on strengthening retrieval, sentence segmentation, model conversion, and release infrastructure.
📢 Spark NLP 6.4.1: Late Chunking, Multimodal Embeddings, and Smarter Pretrained Workflows Spark NLP 6.4.1 is a feature-rich follow-up release that expands retrieval and multimodal capabilities while improving pretrained model loading and production robustness.
📢 Spark NLP 6.4.0: LLM-Powered Entity Extraction, Expanded Document Readers, and Pipeline Robustness Spark NLP 6.4.0 is a feature-rich release focused on bringing LLM-powered extraction into standard NLP pipelines, dramatically expanding the document reader ecosystem, and hardening production ingestion workflows.
📢 Spark NLP 6.3.3: ModernBERT Embeddings, Vector DB Integration, and Layout-Aware Document Processing Spark NLP 6.3.3 is a feature-packed release aimed at practitioners building modern NLP and multimodal document pipelines.
📢 Spark NLP 6.3.2: Scala 2.13 Support, Layout-Aware Images, and Enhanced LightPipeline Tracking Spark NLP 6.3.2 is a foundational release that introduces official support for Scala 2.13, alongside important improvements in document layout understanding and lightweight inference workflows.
📢 Spark NLP 6.3.1: LLM Backend Upgrade and Document Processing Improvements Spark NLP 6.3.1 focuses on strengthening distributed local LLM inference by upgrading the jsl-llamacpp backend to a newer llama.cpp release, while also delivering important improvements in document structure handling and metadata consistency.
📢 Spark NLP 6.2.3: Further Improvements for NerDL Spark NLP 6.2.3 introduces targeted improvements to training performance and stability of NerDLApproach and bug fixes for CamemBertForTokenClassification. NerDLApproach now uses new internal data-loading behavior, and improving training speed and preventing out-of-memory errors.
📢 Spark NLP 6.2.2: Bugfix Release Spark NLP 6.2.2 brings bug fixes to WordEmbeddings and NerDLApproach logging. 🐛 Bug Fixes - WordEmbeddings: Fixed a bug where WordEmbeddings would duplicate input tokens in the output - NerDLApproach: Fixed a bug during logging, that would show inaccurate training/validation counts.
📢 Spark NLP 6.2.1: Enhanced hierarchical document processing and training optimizations Spark NLP 6.2.1 brings significant improvements to document ingestion with expanded hierarchical support, XML processing enhancements, and optimizations for NerDL training.
📢 Spark NLP 6.2.0: A new stage for unstructured document ingestion and processing at scale Spark NLP 6.2.0 introduces key upgrades across entity extraction, document normalization, HTML reading, and GGUF-based models.
📢 Spark NLP 6.1.5: Smarter Readers and More Resilient Pipelines Spark NLP 6.1.5 focuses on improving data ingestion reliability and pipeline flexibility. This release enhances reader components with better fault tolerance, broader input support, and introduces a new ReaderAssembler annotator for streamlined integration.
Releasesby Glyph