Dataflow Kit Web Scraper

OpenAPI apis-guru developer_tools

Render Javascript driven pages, while we internally manage Headless Chrome and proxies for you.

Build a custom web scraper with our Visual point-and-click toolkit.
Scrape the most popular Search engines result pages (SERP).
Convert web pages to PDF and capture screenshots.

Authentication

Dataflow Kit API require you to sign up for an API key in order to use the API.

The API key can be found in the after free registration.

Pass a secret API Key to all API requests to the server as the api_key query parameter.

Homepage: https://api.apis.guru/v2/specs/dataflowkit.com/1.3.json
Provider: dataflowkit.com
OpenAPI version: 3.0.0
Spec (JSON): https://api.apis.guru/v2/specs/dataflowkit.com/1.3/openapi.json
Spec (YAML): https://api.apis.guru/v2/specs/dataflowkit.com/1.3/openapi.yaml

Tools (7)

Extracted live via the executor SDK.

fetch.postOperation

Use fetch endpoint to download web pages.
parse.postOperation

Dataflow kit uses CSS selectors to find HTML elements in web pages for later data extraction.
Open and click desired elements on a page to specify extracting data.
Then you can send generated payload to /parse endpoint. We crawl web pages and extract data like text, links, or images for you following the specified rules.
Extracted data is returned in CSV, MS Excel, JSON, JSON(Lines) or XML format.
serp.postOperation
To crawl search engine result pages, you can use /serp endpoint. SERP collection service extracts a list of organic results, news, images, and more. Specify configuration parameters, such as country or languages, to customize output SERP data. The following search engines are supported
- google
- google-image
- google-news
- google-shopping
- bing
- duckduckgo
- baidu
- yandex
Generate ready-to-run code for your favorite language at
urlToPdf.postConvertUrlPdf

Automate URL to PDF Conversion right in your application.
Specify request parameters like URL, Proxy, and actions to render web pages to PDF using Headless Chrome.
Get resulted PDF even from websites blocked in your area for some reason utilizing our worldwide pool of proxies.
Simulate real-world human interaction with the page. For example, before saving a web page to PDF, you may need to scroll it.
Generate ready-to-run code for your favorite language at
urlToScreenshot.postConvertUrlScreenshot

Automate URL to Screenshot Conversion right in your application.
Specify request parameters like URL, Proxy, and actions to convert web pages to screenshots using Headless Chrome.
Get resulted pictures in JPG or PNG formats even from websites blocked in your area for some reason utilizing our worldwide pool of proxies.
Simulate real-world human interaction with the page. For example, before capturing a web page, you may need to scroll it.
Generate ready-to-run code for your favorite language at
openapi.previewSpec

Preview an OpenAPI document before adding it as a source
openapi.addSource

Add an OpenAPI source and register its operations as tools