Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added uploading dataset and drag & drop support #317

Open
wants to merge 39 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
39 commits
Select commit Hold shift + click to select a range
d126f34
added uploading dataset and drag & drop support
AjayThorve Oct 18, 2021
0a0616e
fix client-server bug
AjayThorve Oct 18, 2021
19c189a
added server side pagination API
AjayThorve Oct 19, 2021
e0a39c0
create dir if not exists
AjayThorve Oct 19, 2021
69d5ce9
Merge branch 'main' into demo/viz-app/improvements
AjayThorve Oct 21, 2021
f0fa54d
added redbird node based reverse-proxying
AjayThorve Oct 22, 2021
90e5eb3
apply suggestions
AjayThorve Oct 22, 2021
6a919aa
update readme instructions
AjayThorve Oct 22, 2021
ce3cdaa
typo
AjayThorve Oct 22, 2021
5dc3eda
change front-end app port
AjayThorve Oct 22, 2021
59d279a
add missing license text
AjayThorve Oct 22, 2021
8058756
update rest api routes as per suggestions
AjayThorve Oct 27, 2021
df6f994
fix route name
AjayThorve Oct 27, 2021
0625236
removed unnecessary condition
AjayThorve Oct 27, 2021
f7f0d74
bug fixes and improvements
AjayThorve Oct 28, 2021
8ba7977
sending arrow tables to the client directly
AjayThorve Oct 28, 2021
0bac16f
update route
AjayThorve Oct 28, 2021
e28eb5a
typo fix route
AjayThorve Oct 28, 2021
f589db7
update apache-arrow version
AjayThorve Oct 28, 2021
6420370
revert apache arrow version update
AjayThorve Oct 28, 2021
cba5b22
add apache-arrow based streaming
AjayThorve Oct 29, 2021
5881444
add updated viz to html front-end as well
AjayThorve Oct 29, 2021
5c504ea
handle cases where numRows is less than pageIndex*pageSize
AjayThorve Oct 29, 2021
8174c67
Update modules/demo/viz-app/pages/demo/graph.jsx
AjayThorve Nov 11, 2021
765e61e
Merge branch 'main' into demo/viz-app/improvements
AjayThorve Jan 19, 2022
eb95097
Merge branch 'main' of github.com:rapidsai/node into demo/viz-app/imp…
trxcllnt Jan 20, 2022
bd535a5
update math.gl version
trxcllnt Jan 20, 2022
b7fde93
Merge branch 'main' of github.com:rapidsai/node into demo/viz-app/imp…
trxcllnt Jan 24, 2022
b4dc58a
Merge branch 'main' of github.com:rapidsai/node into demo/viz-app/imp…
trxcllnt Jan 27, 2022
5718e16
add missing parameters
trxcllnt Jan 27, 2022
47de288
add missing const and script type
trxcllnt Jan 27, 2022
48de9ca
fix graph viz column dtypes
trxcllnt Jan 27, 2022
b59926c
Update yarn.lock
trxcllnt Jan 27, 2022
b6a27f3
separate makeDeck from the render class, and generalize the render mo…
AjayThorve Feb 4, 2022
e3ec1a0
Merge branch 'main' into demo/viz-app/improvements
AjayThorve Feb 4, 2022
27bb83f
Merge branch 'main' into demo/viz-app/improvements
AjayThorve Feb 28, 2022
e23304f
fix graph api
AjayThorve Feb 28, 2022
9ca9a98
update forceatlas2 calculations
AjayThorve Feb 28, 2022
d3be34c
fix positions
AjayThorve Feb 28, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions modules/demo/ssr/graph/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,7 @@
"fastify-multipart": "5.0.2",
"fastify-cors": "6.0.2",
"fastify-arrow": "0.1.0",
"apache-arrow": "6.0.0",
AjayThorve marked this conversation as resolved.
Show resolved Hide resolved
"nanoid": "3.1.25",
"rxjs": "6.6.7",
"shm-typed-array": "0.0.13",
Expand Down
21 changes: 10 additions & 11 deletions modules/demo/ssr/graph/plugins/api/index.js
Original file line number Diff line number Diff line change
Expand Up @@ -219,23 +219,22 @@ module.exports = function(fastify, opts, done) {
} catch (err) { reply.code(500).send(err); }
})

fastify.post('/dataframe/read', async (request, reply) => {
const pageIndex = request.body.pageIndex;
const pageSize = request.body.pageSize;
const dataframe = request.body.dataframe; //{'nodes', 'edges'}
fastify.get('/dataframe/read', async (request, reply) => {
const pageIndex = parseInt(request.query.pageIndex);
const pageSize = parseInt(request.query.pageSize);
const dataframe = request.query.dataframe; //{'nodes', 'edges'}
const [res, numRows] =
await getPaginatedRows(fastify[clients][request.query.id].data[dataframe].dataframe,
pageIndex,
pageSize,
fastify[clients][request.query.id].state.selectedInfo[dataframe]);

reply.send(JSON.stringify({page: res.toArray(), numRows: numRows}));
// try {
// // RecordBatchStreamWriter.writeAll(res).pipe(reply.stream());
// } catch (err) {
// request.log.error({err}, '/run_query error');
// reply.code(500).send(err);
// }
try {
RecordBatchStreamWriter.writeAll(res).pipe(reply.stream());
} catch (err) {
request.log.error({err}, '/run_query error');
reply.code(500).send(err);
}
});

done();
Expand Down
2 changes: 1 addition & 1 deletion modules/demo/viz-app/package.json
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
"@fortawesome/free-solid-svg-icons": "5.15.3",
"@fortawesome/react-fontawesome": "0.1.14",
"@rapidsai/cudf": "0.0.1",
"apache-arrow": "^4.0.0",
"apache-arrow": "^6.0.0",
"bootstrap": "4.6.0",
"d3": "6.6.2",
"echarts": "5.0.2",
Expand Down