No packages match

openalexPro - Providing a more advanced access to OpenAlex for the power user

Retrieves large result sets from the 'OpenAlex' API (<https://openalex.org>) without holding them in memory. Queries are built and validated with classic filters and search, or written in 'OpenAlex' query language (OQL) or its JSON form (OQO). Results are downloaded page by page to JSON files, with cursor paging, parallel downloads, retries and resume, and converted per page with 'DuckDB' to a partitioned 'Apache Parquet' dataset that includes reconstructed abstracts and citation strings. Full-text PDFs and TEI XML can be downloaded, and the daily API budget can be inspected.

Last updated

quarto

4.67 score 8 stars 2 dependents 13 scripts

openalexVectorComp - Embedding Vectorization and Distance-Based Scoring Workflows

R-first orchestration for text vectorization (embeddings), embedding distance computation, and distance-based scoring workflows. Supports backend-neutral embedding providers (HF, OpenAI, TEI), prototype cosine-distance scoring, reference-area distance scoring, and threshold calibration utilities.

Last updated

quarto

4.45 score 9 scripts

openalexSnapshot - OpenAlex Bulk Snapshot Conversion, Indexing, and Record Extraction

Provides tools for working with the OpenAlex bulk snapshot: converting .json.gz files to Parquet format, building ID, DOI and inverted-citation indexes over the resulting corpus, and extracting records by OpenAlex ID or DOI. Also provides an offline view of the citation graph, so the works citing or cited by a given paper can be retrieved without network access. Indexing and extraction are implemented in R over DuckDB. The package is pure R: no compiled code, and no Rust toolchain is needed to install it.

Last updated

quarto

2.78 score 1 dependents 6 scripts

openalexSnowball - Snowball searches for OpenAlex using the openalexPro pipeline

Perform snowball searches on the OpenAlex citation graph using openalexPro's on-disk processing pipeline and store results in Parquet.

Last updated

quarto

2.60 score 3 scripts

openalexConvert - Convert OpenAlex Parquet (from openalexPro) to other Formats

Utilities to convert an OpenAlex parquet/Arrow corpus into other formats. Implemented are at the moment CSL JSON, BibTeX, BibLaTeX, Markdown, LaTeX, HTML, or PDF via Pandoc. Uses DuckDB over Arrow for efficient chunked CSL JSON conversion.

Last updated

quarto

2.30 score 4 scripts