Service Integration
How to make Brightbot work with a new service
Brightbot integrates with various data stack services using the Datapiary library. This library enables Brightbot to provide a uniform data model for each type of service, ensuring consistency and ease of use.
Datapiary supports a range of service types, each of which plays a vital role in the data stack. These service types include:
Ingestion services
These services are responsible for ingesting data from different sources and bringing it into the data stack.
Catalog services
Catalog services provide an organized view of data assets, making it easier for users to find and use the data they need.
Data Quality services
These services are responsible for ensuring the quality of data by detecting and addressing issues such as duplicates, missing values, and inconsistent formatting.
Warehouse services
These services provide storage for large volumes of structured and semi-structured data.
Notebook services
Notebook services provide an interactive environment for data analysis and visualization.
Transformation services
These services are used to transform data, making it more suitable for analysis and insights.
End-use services
These services are responsible for delivering data to end users in a format and manner that is most useful to them. These include table connections, downloads, BI, reverse ETL, API, and RAG endpoints.
By integrating these services using Datapiary, Brightbot can provide a comprehensive, consistent, and reliable data stack.