API Reference

• Configuration (core.config)
  • Base
  • Pipeline
  • Component
  • Spark
  • Retry
  • Hooks
  • Secrets
  • Loader
  • Presets
  • Validator
• Components (core.component)
  • Base
  • Protocols
  • Exceptions
• Schema (core.schema)
  • Definition
  • Validator
• Resilience (core.resilience)
  • Retry
  • Circuit Breaker
• Data Quality (core.quality)
  • Types
  • Checks
• Audit (core.audit)
  • Types
  • Sinks
  • Filters
• Secrets (core.secrets)
  • Base
  • Providers
  • Resolver
  • Audit
• Metrics (core.metrics)
  • Registry
• Session (runtime.session)
  • Wrapper
• DataFlow (runtime.dataflow)
  • Base
  • Schema
• Streaming (runtime.streaming)
  • Base
  • Sources
  • Sinks
  • Hooks
• Dynamic Loader (runtime.loader)
  • load_component_class()
  • instantiate_component()
  • validate_component_class()
  • list_available_components()
• Schema Converter (runtime.schema_converter)
  • to_struct_type()
  • from_struct_type()
• Runner (runner)
  • Hooks
  • Built-in Hooks
  • Result
  • Simple Runner
  • Checkpoint
  • Quality Hooks
  • Audit Hooks
• Examples (examples)
  • Batch
  • Streaming