Hi all! The team at Context Data launched an open source no-code ETL framework for Vector databases. The framework allows devs to pull data from multiple sources, embed and write final data to multiple vector database/store targets using just a yaml configuration file.

We'd love your feedback!

Github: https://github.com/ContextData/VectorETL

Documentation: https://vectoretl.contextdata.dev/index.html

We've open-sourced our no-code ETL framework for Vector Data processing to allow AI engineers seamlessly process data from multiple data sources to ALL MAJOR vector databases using just a config file.

I'd love to get your feedback!

About a month and a half ago, I was at the Netflix Data Engineering Open Forum where I presented some work that I've been doing on building a Data architect agent.

I was reviewing the slides last night and decided to share them to the public.

I would really appreciate your thoughts and feedback.

After launching our MVP late last year, one of the most consistent feedback we got was around our transformations function where users complained about the clunkiness and the steep learning curve. After extensive interviews with our beta users, we came to the realization that over 90% of users had some experience using DBT or were using DBT within their data organizations.

cc: https://contextdata.ai

Building enterprise level RAG solutions take more than building the application but also building the data platform and infrastructure that the application has to depend upon

Thanks for the feedback! I'll explore this topic for upcoming articles for a deeper dive

Thanks for the feedback! I'll make this the topic of my next article and do a deeper dive on this

A few months ago, I taught a class on Vector Databases for a TGE Data private client and then decided to record it into a short course for a wider audience.

The course is a mix of theory and demos discussing some of the underlying concepts of Vectors, Vector Databases, Indexing, Search Similarity and ending with demos specifically for Pinecone and Weaviate databases.

Cool! Is there a video as well, then?

There is but it's a udemy course unfortunately. I don't want to spam the group with links but the link is on the lat page of the document

If you have a discount code you can share, it would provide a neat excuse for posting the link in a comment along side it ;)

Thank you! That's a great idea. I created a discount coupon which is active for the next 5 days up until Jan 17th

https://www.udemy.com/course/vector-databases-deep-dive/?cou...

Thanks :) I bought a copy now.

I already have a Udemy account so when I went to checkout and logged in it said the promo was for new users only. But I went back to the course page again and reloaded the page so that I was logged in and then I was able to buy it with the coupon applied.

Experienced Data Engineer & Architect

Location: Chicago, IL

Remote: Yes

Willing to relocate: Yes

Technologies: Python - Django - Scala - NodeJS - SQL - AWS - Docker - Azure - GCP - Neo4j - Snowflake - Pyspark - Tensorflow - Pytorch - Databricks - DBT - ML Ops

Résumé/CV: https://jide.nyc3.cdn.digitaloceanspaces.com/Babajide_D_Ogun...

Email: jogunjobi@gmail.com

Location: Chicago, IL

Remote: Yes

Willing to relocate: Yes Technologies: - Python - Django - Scala - NodeJS - SQL - AWS - Docker - Azure - GCP - Neo4j - Snowflake - Pyspark - Tensorflow - Pytorch - Databricks - DBT - ML Ops

Résumé/CV: https://jide.nyc3.cdn.digitaloceanspaces.com/Babajide_Ogunjo...

Email: jogunjobi@gmail.com