Package: fastreg 0.13.8
fastreg: Fast Conversion and Querying of Danish Registers with 'Parquet'
Converts large Danish register files ('sas7bdat') into 'Parquet' format with year-based 'Hive' partitioning and chunked reading for larger-than-memory files. Supports parallel conversion with a 'targets' pipeline and reading those registers into 'DuckDB' tables for faster querying and analyses.
Authors:
fastreg_0.13.8.tar.gz
fastreg_0.13.8.tar.gz(r-4.7-any)fastreg_0.13.8.tar.gz(r-4.6-any)
fastreg_0.13.8.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
card.svg |card.png
fastreg/json (API)
NEWS
| # Install 'fastreg' in R: |
| install.packages('fastreg', repos = c('https://cran.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/dp-next/fastreg/issues
Pkgdown/docs site:https://dp-next.github.io
Last updated from:4cf1cc072f. Checks:4 OK. Indexed: no.
| Target | Result | Time | Files | Syslog |
|---|---|---|---|---|
| linux-devel-x86_64 | OK | 160 | ||
| source / vignettes | OK | 231 | ||
| linux-release-x86_64 | OK | 183 | ||
| wasm-release | OK | 164 |
Exports:convertlist_parquet_datasetslist_parquet_fileslist_sas_filesprint_log_row_countprint_log_schemaread_parquet_datasetread_parquet_fileread_registersimulate_registers_with_pathsuse_templatewrite_to_sas
Dependencies:arrowassertthatbackportsbitbit64blobcachemcheckmateclicliprcmprskcodeCollectioncollectionscpp11crayondata.tableDBIdbplyrdplyrduckdbduckplyrEpietmfabricatrfastmapforcatsfsgenericsgluehavenhmsjsonlitelatticelifecyclelubridatemagrittrMASSMatrixmemoisemgcvnlmenumDerivosdcpillarpkgconfigplyrprettyunitsprogresspurrrR6RcppRcppArmadilloreadrrlangstringistringrsurvivaltibbletidyrtidyselecttimechangetzdbutf8uuidvctrsvroomwithrzoo
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Convert a single register SAS file to Parquet | convert |
| List Parquet datasets or files in a project | list_parquet list_parquet_datasets list_parquet_files |
| List SAS files in a directory | list_sas_files |
| Log chunk information as a table | print_log_row_count |
| Print log schema comparison | print_log_schema |
| Read a single Parquet file or a partitioned dataset as DuckDB table | read_parquet read_parquet_dataset read_parquet_file |
| Read a Parquet register | read_register |
| Simulate example registers along with output paths for SAS files | simulate_registers_with_paths |
| Use a targets pipeline for converting SAS registers to Parquet | use_template |
| Write simulated data to a SAS file | write_to_sas |
