Open-source sdk & api to connect any dataset to ChatGPT

Community
1

Hi,

Just wanted to share Embedbase. Embedbase is an open-source API to easily use OpenAI embeddings in production.

Started out as an internal API for an Obsidian plugin I developed called AVA. We use it in AVA to find similar notes (see small demo), but you can potentially use it to do anything that OpenAI embeddings can do.

Example of a ChatGPT powered for your documentation:

You can have a look at the GitHub repo here:

Would love to get some feedback!

PS: try out the ChatGPT powered documentation, there are tutorials to build it for yourself :slight_smile:

6 Likes
2

Thanks for sharing. Will you be adding support for Weaviate?

1 Like
3

Yes :slight_smile:. Curious what use case would you need Weaviate for rather than Pinecone?

4

Thanks for the response. Mostly because Weaviate is open-source, and it also has more features.

1 Like
5
  • Using OpenAI embeddings to search Paul Graham essays
  • Using OpenAI GPT3 in Apple Siri Shortcut as a functional processing module - here to format text to be spoken by Siri
2 Likes
6

Same on Hackernoon:

7

Just shipped a playground to try https://embedbase.xyz :slight_smile:

1 Like
8

Know the movie Her? :stuck_out_tongue:
This is using retrieval augmented generation thru https://app.anotherai.co/ which indexed about 1 million of my words with (OpenAI embeddings thru https://embedbase.xyz) written over the years + ChatGPT and Siri

https://twitter.com/louis030195/status/1631957948921442305

9

It supports & uses Supabase as vector database FYI now :slight_smile:

10

Also shipped a JS SDK a few weeks ago

You can ask questions to the GPT4-powered documentation FYI

If you need any help with embeddings or GPT-4 contact me (even if you don’t use embedbase :slight_smile:)

11

:rocket: a peek into the future

image
image2762Ă—1804 454 KB

Based on a lot of feedback, we have started integrating the gpt interface directly into our application and this is just the first step to help you ship ChatGPT-powered apps faster. Try the new GPT-4 dashboard here.

:jigsaw: towards modularity

ray-so-export (2)
ray-so-export (2)1248Ă—1074 137 KB

We’ve seen how difficult it is for people to get started with local Embedbase using Supabase, so we decided to implement Postgres, so you can start iterating right away.

:candy: other small goodies

ray-so-export (3)
ray-so-export (3)1840Ă—848 149 KB

Embedbase JS SDK now supports metadata & listing datasets. Imagine throwing unstructured data into embedbase and get all links and everything when searching ala perplexity.ai?

PS: If you feel like it, drop a️ :star: Embedbase. :heart:

12

“how can i run an eth node on raspberry pi?” Demo of using Embedbase to ask questions about

@ethdotorg

and get blazing fast accurate answers by #GPT4 with references Wanna connect GPT-4 to your data, try: https://github.com/different-ai/embedbase

2 Likes
13

:framed_picture: Super excited to finally open-source the embedbase dashboard.

ezgif.com-optimize

Check it out here embedbase/dashboard at main · different-ai/embedbase · GitHub

1 Like
14

:floppy_disk: Added a data table

Right in the open source dashboard

Try it out :slight_smile:

image
image1616Ă—1400 95.8 KB

15

hey :wave:
sharing this week’s updates w/ you

you’re reading the embedbase weekly newsletter, where we share our progress towards building the platform that allows you to easily connect your data to llms (like chatgpt!)

read along to see what we’ve shipped since last week

:rocket: one-click self-host

click here to

Deploy to Render

:mage: a new one-liner to run embedbase

pip install embedbase && embedbase run

:steam_locomotive: shipped a getting started colab

Open In Colab

In addition to that we shipped a google colab (it’s like codesandbox but for python) that allows you to try embedbase using a local embedder and db, running both the api and and python sdk.

:crystal_ball: whats next?

  • we’ll make it easy to add data without code
  • a drop-in js component to create a “chat to your data”
  • much more!

Happy building! :rocket:

1 Like
16

Very cool, following your progress! What features it already has?

1 Like
17

Less than 2 min to go from an idea to a ChatGPT bot you can show to your friends & colleagues.

New feature: Publish your Embedbase Playground

You can now easily share your Embedbase Playground with the public.
a) select data from Embedbase
b) choose a system prompt
c) click on share & copy the link

Embedbase wants to help you ship something in a few minutes, that scales with your needs.

This is just one little step towards helping you ship faster.

ezgif.com-optimize (3)

18

hey openai folks, been shipping lately,

sharing this week’s updates w/ you

you’re reading the embedbase weekly newsletter, where we share our progress towards building a platform that helps you to easily connect your data to llms (like chatgpt!)

đź«š embedbase.generate()

> npm uninstall openai

you no longer need to learn multiple APIs, from context creation to generation, embedbase lets you do it all in one unified and dead simple API.

unnamed
unnamed1840Ă—972 221 KB

:electric_plug: Ask Questions to your Notion Tables with Zapier

we integrated the no-code automation tool Zapier into Embedbase.

we wrote a tutorial that let you ask questions to your Notion here

:candy: goodies

:crystal_ball: whats next?

  • option to have your context built partly with internet results
  • support for multiple LLMs on the hosted version
  • support for agents as first class citizens

it’s 100% open source (everything) btw embedbase/dashboard at main · different-ai/embedbase · GitHub

your feedback means a lot :pray:

happy building! :rocket::rocket::rocket: