Increased prompt limit for Google AI Mode
The maximum prompt length for Google AI Mode source requests has increased from 4,000 to 8,000 characters.
The maximum prompt length for Google AI Mode source requests has increased from 4,000 to 8,000 characters.
LLM sources now support custom browser instructions, allowing you to define actions (e.g., clicks, scrolls, waits) to control page behavior before content is extracted.
A dedicated parser for Home Depot product pages is now available through the universal scraping source. Enable parsing on your request to receive structured product data (such as title, price, availability, and specifications) instead of raw HTML.
Google Scholar is now a dedicated parsed source in Web Scraper API. Set source to google_scholar and parse to true to receive parsed JSON directly.
We have rolled out improvements to how requests are handled on sites using CAPTCHA. Success rates on these targets should improve, particularly for jobs that previously saw elevated failure or retry rates. Learn more in our documentation.
Parsed output from Walmart e-commerce sources now returns pricing data more reliably and consistently. If you're tracking competitor prices or monitoring product catalogs, you'll get cleaner numbers automatically with new requests using "parse": true.
Headless Browser now offers more realistic browser fingerprints and continues to align device-memory values with the rest of the emulated fingerprint to lower detection risk for all users. This change applies automatically to all Headless Browser sessions.
Oxylabs now offers official Agent Skills – structured skill files that teach AI agents and coding assistants work with Oxylabs products with significantly more accurate code and fewer hallucinations.
ChatGPT source requests with search set to true now retry citation extraction automatically, roughly doubling citation coverage in the parsed citations field. The overall request success rate is unchanged, and no payload changes are needed for requests already using search: true.
LLM sources now support up to 5,000 prompts within a single batch request for chatgpt, gemini, and perplexity sources. Every prompt runs as its own job, so you get one job ID back per prompt. Learn more about batch requests here.