ProxynetProxynet

Web Scraping · Proxynet Blog – Page 3

  1. Published

    Web Scraping vs API: Which One Should You Use?

    An API returns the data a provider chooses to share, in a fixed format; web scraping reads the page itself. We compare both and fetch the same data both ways.

    Written by: Acar Diveroli

  2. Published

    What Is Web Scraping and How Does It Work?

    Web scraping is the automated collection of data from web pages: a program downloads the HTML, picks out fields and saves them. How it works and what it is for.

    Written by: Acar Diveroli

  3. Published

    Cheerio Web Scraping in Node.js: A Step-by-Step Tutorial

    Cheerio parses HTML in Node.js with jQuery-style selectors. Build a tested scraper with fetch, pagination, a concurrency limit, retries, JSON and a proxy.

    Written by: Acar Diveroli

  4. Published

    How to Clean Scraped Data with Pandas in Python

    Clean scraped data with pandas by fixing text first, then types, duplicates, gaps and outliers, and validating before you save. A full tested script included.

    Written by: Acar Diveroli

  5. Published

    How to Extract Data From PDF Files: Tables, Text and OCR

    Check whether the PDF has a text layer first. If it does, Excel or pdfplumber reads the tables directly; scanned pages need OCR. Tested Python code inside.

    Written by: Acar Diveroli

  6. Published

    How to Handle Personal Data (PII) in Scraped Datasets

    Scraped data often carries personal data: names, profile links, emails and phone numbers in free text. How to find it, cut it down, mask it and store it safely.

    Written by: Acar Diveroli

  7. Published

    How to Save Scraped Data to CSV, JSON and SQLite

    Save scraped rows to CSV for spreadsheets, JSON Lines for append-only logs and SQLite for deduplicated, incremental runs. Tested Python code included.

    Written by: Acar Diveroli

  8. Published

    What Is Data Parsing? Parser Types, Errors and Examples

    Data parsing turns raw input such as HTML, JSON, CSV or logs into structured records your code can use. How parsers work, the main types and the usual errors.

    Written by: Acar Diveroli

  9. Published

    What Is ETL? Extract, Transform, Load With a Python Example

    ETL means extracting data from a source, cleaning it into a fixed shape and loading it into a database. How it works, ETL vs ELT and a tested Python job.

    Written by: Acar Diveroli

  10. Published

    How to POST JSON with Python Requests: cURL Equivalents

    To POST JSON with Python Requests, call requests.post(url, json=data) and the Content-Type is set for you. See how data=, params=, headers and cURL flags map.

    Written by: Acar Diveroli

  11. Published

    How to Build a Web Crawler in Python, Step by Step

    A Python web crawler queues the links it finds from a start URL and visits each page once. We build the queue, URL normalization, depth limit and scope in code.

    Written by: Acar Diveroli

  12. Published

    What Is BeautifulSoup and How Do You Use It in Python?

    BeautifulSoup is a Python library that turns downloaded HTML into a searchable tree. We cover parser choice, find_all versus select, and reading HTML tables.

    Written by: Acar Diveroli

  1. Web Scraping vs API: Which One Should You Use?

    Comparison

    Published

  2. What Is Web Scraping and How Does It Work?

    Web Scraping

    Published

  3. Cheerio Web Scraping in Node.js: A Step-by-Step Tutorial

    Tutorial

    Published

  4. How to Clean Scraped Data with Pandas in Python

    Tutorial

    Published

  5. How to Extract Data From PDF Files: Tables, Text and OCR

    Tutorial

    Published

  6. How to Handle Personal Data (PII) in Scraped Datasets

    Web Scraping

    Published

  7. How to Save Scraped Data to CSV, JSON and SQLite

    Tutorial

    Published

  8. What Is Data Parsing? Parser Types, Errors and Examples

    Web Scraping

    Published

  9. What Is ETL? Extract, Transform, Load With a Python Example

    Web Scraping

    Published

  10. How to POST JSON with Python Requests: cURL Equivalents

    Tutorial

    Published

  11. How to Build a Web Crawler in Python, Step by Step

    Web Scraping

    Published

  12. What Is BeautifulSoup and How Do You Use It in Python?

    Web Scraping

    Published