close

DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The German Web Scraping Market: €190M and Growing

The German Web Scraping Market: €190M and Growing

Comments
4 min read
DSGVO-Compliant Web Scraping: What German Businesses Need to Know

DSGVO-Compliant Web Scraping: What German Businesses Need to Know

Comments
4 min read
Automating Web Intelligence with Python: A Practical Guide

Automating Web Intelligence with Python: A Practical Guide

Comments
4 min read
I Built a Web Scraper API That Handles JS Rendering, CAPTCHAs, and Proxies

I Built a Web Scraper API That Handles JS Rendering, CAPTCHAs, and Proxies

Comments
2 min read
Python Web Scraping for Business Intelligence: Monitor Competitors 24/7 for Free

Python Web Scraping for Business Intelligence: Monitor Competitors 24/7 for Free

Comments
2 min read
xcrawl-scraper v1.0.1 — Node.js SDK for Web Scraping

xcrawl-scraper v1.0.1 — Node.js SDK for Web Scraping

BERJAYA 1
Comments
1 min read
Raw HTML is where LLM context goes to die

Raw HTML is where LLM context goes to die

BERJAYA 1
Comments
5 min read
Scraping Chinese Social Platforms for LLM Training Data: A Practical Multi-Source Pipeline (Python, 2026)

Scraping Chinese Social Platforms for LLM Training Data: A Practical Multi-Source Pipeline (Python, 2026)

Comments
7 min read
Requests vs curl_cffi vs Playwright: Which Network Stack Actually Fits Your Data Collection Workflow?

Requests vs curl_cffi vs Playwright: Which Network Stack Actually Fits Your Data Collection Workflow?

Comments
5 min read
What to do when websites change and your spider doesn't know

What to do when websites change and your spider doesn't know

BERJAYA 1
Comments
6 min read
Web Scraping in 2024: Whats Legal, Whats Not, and What Works

Web Scraping in 2024: Whats Legal, Whats Not, and What Works

Comments
6 min read
How to Get Google, Bing, and Yandex Search Results as JSON

How to Get Google, Bing, and Yandex Search Results as JSON

Comments
2 min read
Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Weibo's Hot Search Is the Best Real-Time Feed of Chinese Public Sentiment in 2026

Comments
4 min read
How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

How to Give Your AI Agent Live Web Access Without Feeding It Raw HTML

Comments
7 min read
How to scrape Google Maps without code: a REST API tutorial

How to scrape Google Maps without code: a REST API tutorial

Comments
5 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.