Cedar Valley Farms
Cedar Valley Farms is a project that helps cannabis operators increase their efficiency with the help of data-based insights.
Our client is located in Colorado, US. The cannabis operators’ points of sale there usually provide their data to various services for storage and analysis. However, the different APIs that these services use make communication between them complicated.
The company wanted to facilitate the process of gathering and analyzing sales data from various locations, so they partnered with us to create a single database with analytical tools.
Create a service that will collect and structure sales data into one database.
Facilitate data analysis by building visualization tools.
We were responsible for
Backend engineer / Data engineer
How we built it
We started the project with the initial research, business understanding, framing the problem, and defining requirements.
Here, we analyzed what data was already available for our client, determined the data properties, and chose the tech stack we were going to use to collect and process data.
We have developed secure authentication, a data collection feature, and a three-step data pipeline that will allow dashboards and charts to use processed data.
We tested the solution and fixed some minor bugs.
The model is released and the first users registered on the service.
We continue to improve and update the algorithms to ensure the most accurate data aggregation.
The Cedar Valley Farms service collects data from analytical platforms once an hour and stores it as JSON files to prepare it for the data pipeline.
A three-step pipeline includes:
Converting data into the canonical format to facilitate its analysis.
Data aggregation by various categories (location, brand, employees).
The set of REST API’s endpoints that allow using data in dashboards and charts (data frames).
When the pipeline is finished, users can access the data frames and take the necessary data.
When users log in to the system, they receive a token with a certain level of access that allows them to see the corresponding data. It enables additional data protection.
Challenge and Solution
Flowhub is an analytical service that helps with managing data about cannabis sales. We needed to integrate it with our service, but Flowhub doesn’t have webhooks to set this up correctly.
We used long polling to successfully integrate Flowhub into our platform.
What we have now
The project is released.
Business goals are achieved.
The service receives positive feedback from users.