Public Data API

Public data from Python or the command line: arXiv preprints, scholarly works from OpenAlex, ClinicalTrials.gov studies, FDA adverse-event reports, World Bank indicators, daily weather, Wikipedia summaries, Wikidata entities, Open Library books and NVD vulnerabilities, as JSON or CSV. The code is free and open source (MIT). Each of these sources publishes its own public API; this package puts all ten behind one client and one QuanticData sign-in, returns the same flat rows and CSV export for every source, retries on rate limits and dropped connections, and runs long jobs in the background.

pip install git+https://github.com/quantumproxies/public-data-api
public-data login
public-data arxiv "retrieval augmented generation" --max-results 25 -o papers.csv

login opens the QuanticData sign-in page in your browser. New accounts get $2 of free usage every month, no card required: create one.

worldbank needs an indicator code and --countries: public-data worldbank NY.GDP.MKTP.CD --countries IT DE --year-from 2015. weather takes a place name or --latitude / --longitude, with --days ahead (1 to 16) and --past-days of history (0 to 92). wikipedia and wikidata read any language edition with --lang; trials filters with --condition and --status; cve looks up one record with --cve-id or filters with --severity and --known-exploited.

A real row from public-data arxiv "retrieval augmented generation" --max-results 2 (2026-10-23):

{
  "doi": null,
  "url": "https://arxiv.org/abs/2506.06962v3",
  "rank": 1,
  "title": "AR-RAG: Autoregressive Retrieval Augmentation for Image Generation",
  "authors": [
    "Jingyuan Qi",
    "Zhiyang Xu",
    "Qifan Wang",
    "Lifu Huang"
  ],
  "comment": "Image Generation, Retrieval Augmented Generation",
  "pdf_url": "https://arxiv.org/pdf/2506.06962v3",
  "updated": "2025-06-14T00:40:34Z",
  "version": 3,
  "abstract": "We introduce Autoregressive Retrieval Augmentation (AR-RAG), a novel paradigm that enhances image generation by autoregressively incorporating knearest neighbor retrievals at the patch level.",
  "arxiv_id": "2506.06962v3",
  "published": "2025-06-08T01:33:05Z",
  "categories": [
    "cs.CV"
  ],
  "journal_ref": null,
  "author_count": 4,
  "primary_category": "cs.CV"
}

from quanticdata_public_data_api import OpenData

data = OpenData()  # saved login, or QUANTICDATA_API_KEY

papers = data.arxiv("retrieval augmented generation", sort="latest", max_results=25)
for p in papers:
    print(p["published"], p["primary_category"], p["title"])

gdp = data.worldbank("NY.GDP.MKTP.CD", countries=["IT", "DE"], year_from=2015)
gdp.to_csv("gdp_it_de.csv")

trials = data.trials("cancer immunotherapy", status="RECRUITING", max_results=50)
print(len(trials), trials.rows[0]["nct_id"], trials.rows[0]["phases"])

rome = data.weather("Rome", days=7)
for d in rome:
    print(d["date"], d["weather"], d["temp_min_c"], d["temp_max_c"])

log4shell = data.cve(cve_id="CVE-2021-44228")
print(log4shell.rows[0]["severity"], log4shell.rows[0]["cvss_score"])

Each call returns a Run: iterate it for the rows (plain dicts), take len(), or save it with to_csv(), to_json(), to_jsonl() or to_dataframe() (pandas). Errors are specific: InsufficientCredit, RateLimited, InvalidInput, JobFailed, AuthError.

• Literature search: Collect the newest arXiv preprints and the most cited OpenAlex works on a topic into one CSV, with year, authors, DOI, citations and PDF links. See examples/literature_search.py.
• Country indicator panel: Pull several World Bank indicators for a list of countries and write one row per country and year, one column per indicator. See examples/country_indicators.py.
• Known exploited CVEs in your stack: Check the products you run against the CISA Known Exploited Vulnerabilities catalog, with CVSS score, due date and patch links. See examples/kev_check.py.

Results print as a table; -o file.csv, -o file.json or -o file.jsonl writes a file. List inputs take a b c, a,b,c, @file.txt (one per line) or - (stdin). --no-wait starts a long run in the background and prints its id; public-data run <id> -o out.csv collects it later.

Preprint search on arXiv — abstracts, authors, categories and PDF links.

public-data arxiv QUERY [options]

Scholarly works from OpenAlex: title, authors, year, citations, DOI, venue, open-access link, abstract, topic and institutions.

public-data papers QUERY [options]

Studies from ClinicalTrials.gov — status, phase, conditions, interventions, sponsor.

public-data trials [QUERY] [options]

Drug adverse-event reports from the FDA FAERS database — drugs, reactions, seriousness.

public-data fda QUERY [options]

World Bank development indicators per country and year, by indicator code: GDP, population, inflation and the rest of the World Bank catalog.

public-data worldbank INDICATOR [options]

Daily weather for a place name or coordinates, from Open-Meteo: conditions, temperatures, precipitation, wind, UV, sunshine, sunrise and sunset, up to 16 days ahead and 92 days back.

public-data weather [LOCATION] [options]

Wikipedia article summaries, by search query or exact titles, in any language edition: lead extract, short description, images, Wikidata id, coordinates and last edit.

public-data wikipedia [QUERY] [options]

Resolve a name to a stable Wikidata entity id — the join key for entity linking.

public-data wikidata QUERY [options]

Book search over the Open Library catalog — ISBN, authors, ratings, covers.

public-data books QUERY [options]

Vulnerabilities from the NIST NVD — CVE id, description, CVSS score, severity, CWE.

public-data cve [KEYWORD] [options]

• public-data login signs you in with OAuth 2.1 and PKCE in the browser. The token is stored in ~/.config/quanticdata/credentials.json (readable only by you) and refreshed automatically. One login serves every QuanticData tool on the machine.
• No browser on the machine (SSH, Docker, Colab): run public-data login --no-browser, open the link anywhere, then paste back the address the browser ends on.
• Scripts and CI: set QUANTICDATA_API_KEY to a key from the dashboard, or store one with public-data login --api-key.
• public-data logout revokes the token. The connection is listed under API keys in the dashboard as "API · QuanticData CLI"; deleting that key disconnects every machine that uses it.

The code is free and MIT-licensed. Runs are billed to your QuanticData account per delivered row, at the price shown on each collector page linked above; $2 of usage is free every month and failed runs are never billed. Plans with higher limits: pricing.

The same data over plain HTTP:

curl -X POST https://api.quanticdata.io/v1/scraper/collectors/arxiv_papers/run \
  -H "Authorization: Bearer $QUANTICDATA_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"input": {"query": "retrieval augmented generation", "max_results": 2}}'

• API reference with Python, Node, PHP and curl examples.
• MCP server to give Claude, Cursor or any MCP client the same tools.
• n8n node for no-code workflows.

Is this public data API free?

The code is free and MIT-licensed. Runs go through your QuanticData account: $2 of usage is free every month with no card, then you pay per delivered row at the price shown on each collector page. Failed runs are never billed.

Do I need an API key for each source?

No. One QuanticData sign-in covers all ten commands and the requests run on QuanticData's side. Every source here publishes its own public API; what this package adds is one client for all of them, the same flat rows and CSV, JSON or JSONL export for every source, retries on rate limits and dropped connections, and background runs (--no-wait) you collect later with public-data run <run_id>.

How many rows can one run return?

Up to 100 arXiv papers, 200 OpenAlex works, 200 trials, 500 FDA reports, 200 World Bank datapoints, 30 days of weather, 50 Wikipedia articles, 50 Wikidata entities, 100 books or 200 CVEs per run; ask for fewer with --max-results and you pay only for what is delivered.

Which World Bank indicator codes can I use?

Any code of the World Bank catalog, for example NY.GDP.MKTP.CD (GDP in current US$) or SP.POP.TOTL (population). Pass the countries with --countries as ISO2 or ISO3 codes; WLD gives the world total.

Can I export to CSV or Excel?

Add -o results.csv (or .json, .jsonl). Lists such as authors, categories, conditions and reactions are joined with '; ', so the CSV opens cleanly in Excel or Google Sheets.

Can I run it on a schedule?

Yes. Set QUANTICDATA_API_KEY in the environment and call the CLI or examples/kev_check.py from cron, GitHub Actions or any scheduler.

• Financial Data API: Financial data API for Python and the command line.
• Package Registry API: Package registry API for Python and the command line.
• Web Scraper API: Web scraper API for Python and the command line.

MIT. Built and maintained by QuanticData.