GraphRag with GPT4 initial release

Just going over the code right now…super exciting !

Connecting the dots through LLMs

4 Likes

Surprised I’m only reading this now and it was released in February!

Any feeling on this yet?

I ran the demo, used about $6 in API credits generating the knowledge graph on “A Christmas Carol” by Charles Dickens (with GPT-4-Turbo, which was default in the settings).

Needing to dive in more, looks promising, thoughts, experiences? It’s been out a while. :rofl:

Interesting watching it do its thing in the logs. :thinking:

  column_numeric = cast(pd.Series, pd.to_numeric(column, errors="ignore"))
🚀 create_final_relationships
                 source                                target  weight                                        description  ... human_readable_id source_degree target_degree  rank
0     PROJECT GUTENBERG                     A CHRISTMAS CAROL     1.0  Project Gutenberg offers A Christmas Carol as ...  ...                 0             8             4    12
1     PROJECT GUTENBERG                         SUZANNE SHELL     1.0  Suzanne Shell contributed to the Project Guten...  ...                 1             8             1     9
2     PROJECT GUTENBERG                     JANET BLENKINSHIP     1.0  Janet Blenkinship contributed to the Project G...  ...                 2             8             1     9
3     PROJECT GUTENBERG  ONLINE DISTRIBUTED PROOFREADING TEAM     1.0  The Online Distributed Proofreading Team worke...  ...                 3             8             1     9
4     PROJECT GUTENBERG                               SCROOGE     1.0  Scrooge's story, as part of the Project Gutenb...  ...                 4             8            66    74
..                  ...                                   ...     ...                                                ...  ...               ...           ...           ...   ...
180  PROJECT GUTENBERG™                            FOUNDATION     1.0  The Foundation was created to provide a secure...  ...               180             5             5    10
181  PROJECT GUTENBERG™                       MICHAEL S. HART     1.0  Michael S. Hart was the originator and a key c...  ...               181             5             1     6
182          FOUNDATION              INTERNAL REVENUE SERVICE     1.0  The Foundation was granted tax exempt status b...  ...               182             5             1     6
183          FOUNDATION                    SALT LAKE CITY, UT     1.0  The business office of the Foundation is locat...  ...               183             5             1     6
184          FOUNDATION                           MISSISSIPPI     1.0  The Foundation is organized under the laws of ...  ...               184             5             1     6

[185 rows x 10 columns]
🚀 join_text_units_to_relationship_ids
                                  id                                   relationship_ids
0   d6583840046247f428a9f02738842a7c  [30c9641543c24773938bd8ec57ea98ab, 18b839da898...
1   2b5ecb7fba1301d1f3d307e194a6c435  [86505bca739d4bccaaa1a8e0f3baffdc, 6e8d9029ce4...
2   aa8d2310a206001404282ddb3fd645aa  [1af9faf341e14a5bbf4ddc9080e8dc0b, 353d91abc68...
3   cd4234ed6caba8f15d09a2e3ee604b2a  [f2ff8044718648e18acef16dd9a65436, ac41b77ba33...
4   1bdf253855a115bcf51faa63d7b07e82  [87915637da3e474c9349bd0ae604bd95, 7282c73622b...
5   29793cee69d4eefd5fea8a5f2f27b521  [7282c73622b8408e97289d959faff483, ce55841ebfd...
6   b4dec8fbe9f2a2c6a79d09c9484d15ae  [7282c73622b8408e97289d959faff483, 3deb220d31f...
7   f40e4b274b5e1a25afbff9ecb733e1f4  [7282c73622b8408e97289d959faff483, 6e8d9029ce4...
8   04e5c071e4ee5496d5380662e1339f45  [6e8d9029ce4e4ea182367173ab2c7bbf, 101572f552b...
9   6c362d3f8d01c76d84443dcabf3f322a  [6e8d9029ce4e4ea182367173ab2c7bbf, 6fb57f83bae...
10  7064df4af064aeb556e5bab52e896414  [6e8d9029ce4e4ea182367173ab2c7bbf, cbf232211e7...
11  5d70b47bf7167b7586f47fcc4355a746  [0e8d921ccd8d4a8594b65b7fd19f7120, 59c726a8792...
1 Like