Package: maestro 0.4.1
Will Hipson
maestro: Orchestration of Data Pipelines
Framework for creating and orchestrating data pipelines. Organize, orchestrate, and monitor multiple pipelines in a single project. Use tags to decorate functions with scheduling parameters and configuration.
Authors:
maestro_0.4.1.tar.gz
maestro_0.4.1.tar.gz(r-4.5-noble)maestro_0.4.1.tar.gz(r-4.4-noble)
maestro_0.4.1.tgz(r-4.4-emscripten)maestro_0.4.1.tgz(r-4.3-emscripten)
maestro.pdf |maestro.html✨
maestro/json (API)
NEWS
| # Install 'maestro' in R: |
| install.packages('maestro', repos = c('https://cran.r-universe.dev', 'https://cloud.r-project.org')) |
Bug tracker:https://github.com/whipson/maestro/issues
- maestro_tags - Maestro Tags
Last updated 3 days agofrom:f7659be158. Checks:OK: 2. Indexed: no.
| Target | Result | Date |
|---|---|---|
| Doc / Vignettes | OK | Nov 25 2024 |
| R-4.5-linux | OK | Nov 25 2024 |
Exports:build_schedulecreate_maestrocreate_pipelineget_artifactsget_scheduleget_statusinvokelast_build_errorslast_run_errorslast_run_messageslast_run_warningsrun_scheduleshow_networksuggest_orch_frequency
Dependencies:brewcallrclicommonmarkcpp11descdplyrevaluatefansifsgenericsgluehighrknitrlifecycleloggerlubridatemagrittrpillarpkgbuildpkgconfigpkgloadprocessxpspurrrR.methodsS3R.ooR.utilsR6rlangroxygen2rprojrootstringistringrtibbletictoctidyselecttimechangeutf8vctrswithrxfunxml2yaml
Advanced Scheduling
Rendered frommaestro-4-advanced-scheduling.Rmdusingknitr::rmarkdownon Nov 25 2024.Last update: 2024-09-24
Started: 2024-08-02
Directed Acyclic Graphs (DAGs)
Rendered frommaestro-5-directed-acyclic-graphs.Rmdusingknitr::rmarkdownon Nov 25 2024.Last update: 2024-11-21
Started: 2024-11-21
Motivation and Concepts
Rendered frommaestro-2-motivation-concepts.Rmdusingknitr::rmarkdownon Nov 25 2024.Last update: 2024-11-21
Started: 2024-08-02
Quick Start
Rendered frommaestro-1-quick-start.Rmdusingknitr::rmarkdownon Nov 25 2024.Last update: 2024-09-24
Started: 2024-08-02
Use Cases
Rendered frommaestro-3-use-cases.Rmdusingknitr::rmarkdownon Nov 25 2024.Last update: 2024-08-02
Started: 2024-08-02
Readme and manuals
Help Manual
| Help page | Topics |
|---|---|
| Build a schedule table | build_schedule |
| Creates a new maestro project | create_maestro |
| Create a new orchestrator | create_orchestrator |
| Create a new pipeline in a pipelines directory | create_pipeline |
| Get the artifacts (return values) of the pipelines in a MaestroSchedule object. | get_artifacts |
| Get the schedule from a MaestroSchedule object | get_schedule |
| Get the statuses of the pipelines in a MaestroSchedule object | get_status |
| Manually run a pipeline regardless of schedule | invoke |
| Retrieve latest maestro build errors | last_build_errors |
| Retrieve latest maestro pipeline errors | last_run_errors |
| Retrieve latest maestro pipeline messages | last_run_messages |
| Retrieve latest maestro pipeline warnings | last_run_warnings |
| Maestro Tags | maestro_tags |
| Class for a schedule of pipelines | MaestroSchedule |
| Run a schedule | run_schedule |
| Visualize the schedule as a DAG | show_network |
| Suggest orchestrator frequency based on a schedule | suggest_orch_frequency |
