Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

G-retriever (GNN+LLM) example w/ demo #9154

Closed
wants to merge 243 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
243 commits
Select commit Hold shift + click to select a range
2711bac
WIP
puririshi98 Feb 27, 2024
6f672e5
WIP
puririshi98 Feb 27, 2024
5f2d747
WIP
puririshi98 Feb 28, 2024
bdc7b4a
WIP
puririshi98 Feb 28, 2024
5a27041
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
d08c8a1
WIP
puririshi98 Feb 28, 2024
6bc0dff
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
1c2c9bb
WIP
puririshi98 Feb 28, 2024
046a91e
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
2194d47
WIP
puririshi98 Feb 28, 2024
9a58f3f
WIP
puririshi98 Feb 28, 2024
14f1d85
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
503f7aa
Update CHANGELOG.md
puririshi98 Feb 28, 2024
5e3b400
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
4e9b48b
WIP
puririshi98 Feb 28, 2024
fd13459
WIP
puririshi98 Feb 28, 2024
5d86b1f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
604c819
WIP
puririshi98 Feb 28, 2024
2045327
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Feb 28, 2024
739c47a
WIP
puririshi98 Feb 28, 2024
e70425f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Feb 28, 2024
4bc2c6e
WIP
puririshi98 Feb 28, 2024
dbc3278
Update README.md
puririshi98 Feb 28, 2024
4f56b25
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Feb 28, 2024
261b5f9
WIP
puririshi98 Feb 28, 2024
5c59b25
WIP
puririshi98 Feb 28, 2024
2f178d1
WIP
puririshi98 Feb 28, 2024
751cdbe
Update README.md
puririshi98 Feb 29, 2024
fe620f8
Merge branch 'master' into g-retriever
puririshi98 Feb 29, 2024
599a843
WIP
puririshi98 Mar 4, 2024
784143f
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 4, 2024
5cdeece
WIP
puririshi98 Mar 4, 2024
b089e52
WIP
puririshi98 Mar 4, 2024
3118539
WIP
puririshi98 Mar 4, 2024
560c21f
WIP
puririshi98 Mar 4, 2024
4e12b58
WIP
puririshi98 Mar 4, 2024
8a9620b
WIP
puririshi98 Mar 4, 2024
3d7c2fe
WIP
puririshi98 Mar 4, 2024
2d36b6e
WIP
puririshi98 Mar 4, 2024
224257e
WIP
puririshi98 Mar 4, 2024
83e0823
WIP
puririshi98 Mar 4, 2024
86a1958
WIP
puririshi98 Mar 4, 2024
345460e
WIP
puririshi98 Mar 4, 2024
f04a039
WIP
puririshi98 Mar 4, 2024
0a47ad0
WIP
puririshi98 Mar 4, 2024
8b3c3d6
WIP
puririshi98 Mar 4, 2024
d01def1
WIP
puririshi98 Mar 4, 2024
0306c5e
WIP
puririshi98 Mar 4, 2024
92e7b13
WIP
puririshi98 Mar 4, 2024
77b7884
WIP
puririshi98 Mar 4, 2024
8df4944
WIP
puririshi98 Mar 4, 2024
e4edeac
WIP
puririshi98 Mar 4, 2024
d2f3f8d
WIP
puririshi98 Mar 4, 2024
ff98807
WIP
puririshi98 Mar 4, 2024
54e4243
WIP
puririshi98 Mar 4, 2024
70479b4
WIP
puririshi98 Mar 4, 2024
8d4a54a
WIP
puririshi98 Mar 4, 2024
3fb9680
WIP
puririshi98 Mar 4, 2024
a26d364
WIP
puririshi98 Mar 4, 2024
ddf124e
WIP
puririshi98 Mar 4, 2024
7f57d22
WIP
puririshi98 Mar 5, 2024
58dc3a6
WIP
puririshi98 Mar 5, 2024
2b6e1ac
WIP
puririshi98 Mar 5, 2024
2f0526a
WIP
puririshi98 Mar 5, 2024
6be3ec8
WIP
puririshi98 Mar 6, 2024
2437ae9
WIP
puririshi98 Mar 6, 2024
b889c08
WIP
puririshi98 Mar 6, 2024
ddf324d
WIP
puririshi98 Mar 7, 2024
e7ce9b8
WIP
puririshi98 Mar 8, 2024
f8464ed
WIP
puririshi98 Mar 8, 2024
232d092
WIP
puririshi98 Mar 8, 2024
0619c4c
WIP
puririshi98 Mar 8, 2024
c75f237
WIP
puririshi98 Mar 8, 2024
3e1d1cc
WIP
puririshi98 Mar 8, 2024
5da0636
WIP
puririshi98 Mar 8, 2024
c7ccf23
WIP
puririshi98 Mar 8, 2024
a0a54b2
WIP
puririshi98 Mar 8, 2024
2c20442
WIP
puririshi98 Mar 8, 2024
ee34e8f
WIP
puririshi98 Mar 8, 2024
3d7328a
WIP
puririshi98 Mar 8, 2024
84c7480
WIP
puririshi98 Mar 8, 2024
2bc229c
WIP
puririshi98 Mar 8, 2024
e77e60a
WIP
puririshi98 Mar 8, 2024
713bb24
WIP
puririshi98 Mar 8, 2024
58be475
WIP
puririshi98 Mar 8, 2024
767af60
WIP
puririshi98 Mar 8, 2024
688170a
WIP
puririshi98 Mar 8, 2024
e18b6bb
WIP
puririshi98 Mar 8, 2024
bfb2c9e
WIP
puririshi98 Mar 8, 2024
273b5de
WIP
puririshi98 Mar 8, 2024
7413e0f
WIP
puririshi98 Mar 8, 2024
0a7451d
WIP
puririshi98 Mar 9, 2024
450331e
WIP
puririshi98 Mar 10, 2024
3cab62b
WIP
puririshi98 Mar 10, 2024
43703d8
WIP
puririshi98 Mar 11, 2024
9cc4b80
WIP
puririshi98 Mar 11, 2024
7d5216b
WIP
puririshi98 Mar 11, 2024
5fe6e0e
WIP
puririshi98 Mar 11, 2024
835b3ce
WIP
puririshi98 Mar 11, 2024
4a1de19
WIP
puririshi98 Mar 11, 2024
3cd82b6
WIP
puririshi98 Mar 11, 2024
9d39ce2
WIP
puririshi98 Mar 11, 2024
982aea8
WIP
puririshi98 Mar 11, 2024
e4f1596
WIP
puririshi98 Mar 11, 2024
5be2524
WIP
puririshi98 Mar 11, 2024
fbd3293
WIP
puririshi98 Mar 11, 2024
b3bffa4
WIP
puririshi98 Mar 11, 2024
5223861
WIP
puririshi98 Mar 11, 2024
c665137
WIP
puririshi98 Mar 11, 2024
08e518c
WIP
puririshi98 Mar 11, 2024
84efaef
WIP
puririshi98 Mar 11, 2024
f806b8b
WIP
puririshi98 Mar 11, 2024
2f5b3ef
WIP
puririshi98 Mar 11, 2024
a2e2a92
WIP
puririshi98 Mar 11, 2024
0031f84
WIP
puririshi98 Mar 11, 2024
164dd59
WIP
puririshi98 Mar 11, 2024
bf2d0a2
WIP
puririshi98 Mar 11, 2024
ab1533a
WIP
puririshi98 Mar 11, 2024
36a3bb0
WIP
puririshi98 Mar 11, 2024
966f7bc
WIP
puririshi98 Mar 11, 2024
320c396
WIP
puririshi98 Mar 11, 2024
4420951
WIP
puririshi98 Mar 11, 2024
7b3d562
WIP
puririshi98 Mar 11, 2024
f9d88f2
WIP
puririshi98 Mar 11, 2024
9b43a20
WIP
puririshi98 Mar 11, 2024
ebeaa57
WIP
puririshi98 Mar 11, 2024
ff6039e
WIP
puririshi98 Mar 11, 2024
d548b37
WIP
puririshi98 Mar 11, 2024
dde77cc
WIP
puririshi98 Mar 11, 2024
27a410f
WIP
puririshi98 Mar 11, 2024
ed6d86d
WIP
puririshi98 Mar 11, 2024
cd96e41
WIP
puririshi98 Mar 11, 2024
1ec89d2
WIP
puririshi98 Mar 11, 2024
7255c2b
WIP
puririshi98 Mar 11, 2024
cde783a
WIP
puririshi98 Mar 11, 2024
3dbe902
WIP
puririshi98 Mar 11, 2024
0941a1e
Merge branch 'master' into g-retriever
puririshi98 Mar 11, 2024
dc300e3
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
633f11e
WIP
puririshi98 Mar 11, 2024
7c4ac6e
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
6e196a9
WIP
puririshi98 Mar 11, 2024
70a9694
WIP
puririshi98 Mar 11, 2024
c6cd039
WIP
puririshi98 Mar 11, 2024
bd02593
WIP
puririshi98 Mar 11, 2024
4c0a269
WIP
puririshi98 Mar 11, 2024
5a0bc45
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
bdd4dbe
WIP
puririshi98 Mar 11, 2024
9981874
WIP
puririshi98 Mar 11, 2024
c30f2a6
WIP
puririshi98 Mar 11, 2024
594d711
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
fae9a74
WIP
puririshi98 Mar 11, 2024
6bbdac6
WIP
puririshi98 Mar 11, 2024
a738c85
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
40b21d1
WIP
puririshi98 Mar 11, 2024
93ad5d1
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
c370dab
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
533d473
WIP
puririshi98 Mar 11, 2024
3e0315e
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
8847177
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
9d75682
WIP
puririshi98 Mar 11, 2024
c593e54
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
1445052
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
ace869a
WIP
puririshi98 Mar 11, 2024
b9007d5
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
47a3b70
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
b29523d
WIP
puririshi98 Mar 11, 2024
f625ba0
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
638c7a4
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
19fecfc
WIP
puririshi98 Mar 11, 2024
bec232f
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 11, 2024
085a738
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 11, 2024
e4456e9
Merge branch 'master' into g-retriever
puririshi98 Mar 12, 2024
237d9b6
WIP
puririshi98 Mar 12, 2024
8e5f283
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 12, 2024
30ec99f
WIP
puririshi98 Mar 12, 2024
9ddc8d3
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 12, 2024
674b458
WIP
puririshi98 Mar 12, 2024
6f04b4b
WIP
puririshi98 Mar 12, 2024
07882b4
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 12, 2024
5126a9f
WIP
puririshi98 Mar 12, 2024
b033a9c
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 12, 2024
f1b5a7f
WIP
puririshi98 Mar 12, 2024
c5de2c0
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 12, 2024
0c62384
WIP
puririshi98 Mar 12, 2024
f0ec72d
WIP
puririshi98 Mar 12, 2024
d480050
WIP
puririshi98 Mar 12, 2024
3908055
WIP
puririshi98 Mar 12, 2024
b2b8710
WIP
puririshi98 Mar 13, 2024
6e093ad
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 13, 2024
becdae4
WIP
puririshi98 Mar 13, 2024
148dfba
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 13, 2024
4b16db6
Merge branch 'master' into g-retriever
puririshi98 Mar 13, 2024
bec2aa8
WIP
puririshi98 Mar 13, 2024
6c80ad1
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 13, 2024
9f18cfb
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 13, 2024
9a4ebb1
WIP
puririshi98 Mar 13, 2024
b321122
WIP
puririshi98 Mar 13, 2024
1083bfc
WIP
puririshi98 Mar 13, 2024
6cf8056
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 13, 2024
723d663
linting
puririshi98 Mar 13, 2024
54ddd35
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 13, 2024
cc3a962
linting
puririshi98 Mar 13, 2024
699f6a1
linting
puririshi98 Mar 13, 2024
dcd888f
linting
puririshi98 Mar 13, 2024
ebb5efd
linting
puririshi98 Mar 13, 2024
d14cf94
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 13, 2024
f8a983d
linting
puririshi98 Mar 13, 2024
0e4fb49
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 13, 2024
7dda39b
linting is super strict...
puririshi98 Mar 13, 2024
f045626
linting is super strict...
puririshi98 Mar 13, 2024
e39d89b
linting is super strict...
puririshi98 Mar 13, 2024
6e1dc71
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 13, 2024
80da316
linting is super strict...
puririshi98 Mar 13, 2024
107a806
linting is super stricccccbldentkureckegtvjdftneblhtdikldrhg
puririshi98 Mar 14, 2024
d98461c
linting is super stricccccbldentkureckegtvjdftneblhtdikldrhg
puririshi98 Mar 14, 2024
ec99363
linting is super stricccccbldentkureckegtvjdftneblhtdikldrhg
puririshi98 Mar 14, 2024
36e1481
linting is super strict, ignoring the final unimportant ones
puririshi98 Mar 14, 2024
54e1ad8
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 14, 2024
520c7ac
Merge branch 'master' into g-retriever
puririshi98 Mar 15, 2024
6abd9f9
in linting, induced a bug, solving...
puririshi98 Mar 15, 2024
d312bce
in linting, induced a bug, solving...
puririshi98 Mar 15, 2024
7e54909
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 15, 2024
cdc7870
in linting, induced a bug, solving...
puririshi98 Mar 15, 2024
78650c5
in linting, induced a bug, solving...
puririshi98 Mar 15, 2024
9977075
reverted, did necessary cleanup, ignoring all other lint complaints s…
puririshi98 Mar 15, 2024
1f5d719
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 15, 2024
54d7008
reverted, did necessary cleanup, ignoring all other lint complaints s…
puririshi98 Mar 15, 2024
5d0b828
reverted, did necessary cleanup, ignoring all other lint complaints s…
puririshi98 Mar 15, 2024
5c10425
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Mar 15, 2024
98d00de
Merge branch 'master' into g-retriever
puririshi98 Mar 20, 2024
8e78079
Merge branch 'master' into g-retriever
puririshi98 Mar 26, 2024
e0bedbb
update to accomodate latest version of peft, int8->kbit
puririshi98 Mar 26, 2024
4ff8dac
Merge branch 'g-retriever' of https://github.com/pyg-team/pytorch_geo…
puririshi98 Mar 26, 2024
e4dbc8f
Merge branch 'master' into g-retriever
puririshi98 Mar 27, 2024
3fd1d69
Merge branch 'master' into g-retriever
puririshi98 Apr 1, 2024
9c05795
addresing Serge review
puririshi98 Apr 1, 2024
4c945a3
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 1, 2024
18bd2d3
Merge branch 'master' into g-retriever
puririshi98 Apr 2, 2024
1ee3fe9
minor cleanup
puririshi98 Apr 2, 2024
ff4ec90
adding a demo
puririshi98 Apr 4, 2024
b979572
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Apr 4, 2024
f11812e
Merge branch 'master' into g-retriever-w-demo
puririshi98 Apr 4, 2024
b87eac6
Merge branch 'master' into g-retriever-w-demo
puririshi98 Apr 8, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).

### Added

- Added the `WebQSPDataset` dataset with example training G-Retriever (GNN+LLM) ([#8984](https://github.com/pyg-team/pytorch_geometric/pull/8984))
- Added support for `EdgeIndex` in `message_and_aggregate` ([#9131](https://github.com/pyg-team/pytorch_geometric/pull/9131))
- Added `CornellTemporalHyperGraphDataset` ([#9090](https://github.com/pyg-team/pytorch_geometric/pull/9090))
- Added support for cuGraph data loading and `GAT` in single node Papers100m examples ([#8173](https://github.com/pyg-team/pytorch_geometric/pull/8173))
Expand Down
8 changes: 5 additions & 3 deletions examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,10 @@ For examples on [Open Graph Benchmark](https://ogb.stanford.edu/) datasets, see
- [`ogbn_papers_100m.py`](./ogbn_papers_100m.py) is an example for training a GNN on the large-scale `ogbn-papers100m` dataset, containing approximately ~1.6B edges.
- [`ogbn_papers_100m_cugraph.py`](./ogbn_papers_100m_cugraph.py) shows how to accelerate the `ogbn-papers100m` workflow using [CuGraph](https://github.com/rapidsai/cugraph).

For examples on using `torch.compile`, see the examples under [`examples/compile`](./compile).
For examples on co-training LLM with GNN, see examples and README under [`examples/llm_plus_gnn`](./llm_plus_gnn).

For examples on scaling PyG up via multi-GPUs, see the examples under [`examples/multi_gpu`](./multi_gpu).
For examples on using `torch.compile`, see examples and README under [`examples/compile`](./compile).

For examples on working with heterogeneous data, see the examples under [`examples/hetero`](./hetero).
For examples on scaling PyG up via multi-GPUs, see examples and README under [`examples/multi_gpu`](./multi_gpu).

For examples on working with heterogeneous data, see examples and README under [`examples/hetero`](./hetero).
5 changes: 5 additions & 0 deletions examples/llm_plus_gnn/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Examples for LLM and GNN co-training

| Example | Description |
| ------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------- |
| [`g_retriever.py`](./g_retriever.py) | Example for Retriever Augmented Generation (RAG) w/ GNN+LLM by co-training LLAMA2 with GAT for answering questions based on knowledge graph information |
Loading
Loading