Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GraphScope load_from GraphAr has error #4297

Open
DancyHuang opened this issue Oct 23, 2024 · 1 comment
Open

GraphScope load_from GraphAr has error #4297

DancyHuang opened this issue Oct 23, 2024 · 1 comment
Labels

Comments

@DancyHuang
Copy link

when I load from graphar datasource, there has some error.

Steps to reproduce the behavior:
1、

import graphscope;
from graphscope import pagerank
from graphscope.framework.graph import Graph

sess=graphscope.session(cluster_type="hosts")
uri="graphar+file:///home/incubator-graphar-testing-main/ldbc_sample/parquet/ldbc_sample.graph.yml"
g=Graph.load_from(uri,sess)
2、
the Graphr data is download from https://github.com/apache/incubator-graphar-testing

Environment (please complete the following information):

  • GraphScope version: [v0.28 v0.29]
    0.28 has this error and I upgrade graphscope to 0.29, there has the same error.
  • OS: [Linux]
  • python 3.8

errors is below:

g=Graph.load_from(uri,sess)
E20241023 14:57:17.013319 737576 /work/analytical_engine/core/server/dispatcher.cc:153] Worker 0: InvalidValueError occurred on worker 0: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638
decltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}>)())()) boost::leaf::leaf_detail::try_catch_<boost::leaf::context<vineyard::GSError const&, std::string const&, vineyard::GSError const&>, boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}, {lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>(std::decay&, decltype (((declvalstd::decay)())())&&, {lambda()#2}&&, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}&&) + 0x31
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap() + 0x2AD
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragment() + 0x237
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragmentAsFragmentGroup() + 0x7B
LoadGraph + 0x1A1D
gs::GrapeInstance::loadGraph(gs::rpc::GSParams const&) + 0xA68
gs::GrapeInstance::OnReceive(std::shared_ptrgs::CommandDetail) + 0xD63
gs::Dispatcher::processCmd(std::shared_ptrgs::CommandDetail) + 0xD8
gs::Dispatcher::publisherLoop() + 0x1E4
std::get_new_handler() + 0x8F
start_thread + 0xD9
clone + 0x43
2024-10-23 14:57:17,088 [ERROR][rpc:189]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during RunStep, The traceback is: Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 106, in run_step
for response in responses:
File "/usr/local/lib/python3.8/site-packages/grpc/_channel.py", line 543, in next
return self._next()
File "/usr/local/lib/python3.8/site-packages/grpc/_channel.py", line 969, in _next
raise self
grpc._channel._MultiThreadedRendezvous: <MultiThreadedRendezvous of RPC that terminated with:
status = StatusCode.INTERNAL
details = "InvalidValueError occurred on worker 0: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638
decltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}>)())()) boost::leaf::leaf_detail::try_catch
<boost::leaf::context<vineyard::GSError const&, std::string const&, vineyard::GSError const&>, boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}, {lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>(std::decay&, decltype (((declvalstd::decay)())())&&, {lambda()#2}&&, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}&&) + 0x31
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap() + 0x2AD
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragment() + 0x237
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragmentAsFragmentGroup() + 0x7B
LoadGraph + 0x1A1D
gs::GrapeInstance::loadGraph(gs::rpc::GSParams const&) + 0xA68
gs::GrapeInstance::OnReceive(std::shared_ptrgs::CommandDetail) + 0xD63
gs::Dispatcher::processCmd(std::shared_ptrgs::CommandDetail) + 0xD8
gs::Dispatcher::publisherLoop() + 0x1E4
std::get_new_handler() + 0x8F
start_thread + 0xD9
clone + 0x43

InvalidValueError occurred on worker 1: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638
decltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}>)())()) boost::leaf::leaf_detail::try_catch_<boost::leaf::context<vineyard::GSError const&, std::string const&, vineyard::GSError const&>, boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}, {lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>(std::decay&, decltype (((declvalstd::decay)())())&&, {lambda()#2}&&, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}&&) + 0x31
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap() + 0x2AD
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragment() + 0x237
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragmentAsFragmentGroup() + 0x7B
LoadGraph + 0x1A1D
gs::GrapeInstance::loadGraph(gs::rpc::GSParams const&) + 0xA68
gs::GrapeInstance::OnReceive(std::shared_ptrgs::CommandDetail) + 0xD63
gs::Dispatcher::processCmd(std::shared_ptrgs::CommandDetail) + 0xD8
gs::Dispatcher::subscriberLoop() + 0x11C
std::get_new_handler() + 0x8F
start_thread + 0xD9
clone + 0x43

"
debug_error_string = "UNKNOWN:Error received from peer ipv6:%5B::1%5D:54207 {created_time:"2024-10-23T14:57:17.017243402+08:00", grpc_status:13, grpc_message:"InvalidValueError occurred on worker 0: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638\ndecltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}>)())()) boost::leaf::leaf_detail::try_catch_<boost::leaf::context<vineyard::GSError const&, std::string const&, vineyard::GSError const&>, boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}, {lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>(std::decay&, decltype (((declvalstd::decay)())())&&, {lambda()#2}&&, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}&&) + 0x31\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap() + 0x2AD\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragment() + 0x237\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragmentAsFragmentGroup() + 0x7B\nLoadGraph + 0x1A1D\ngs::GrapeInstance::loadGraph(gs::rpc::GSParams const&) + 0xA68\ngs::GrapeInstance::OnReceive(std::shared_ptrgs::CommandDetail) + 0xD63\ngs::Dispatcher::processCmd(std::shared_ptrgs::CommandDetail) + 0xD8\ngs::Dispatcher::publisherLoop() + 0x1E4\nstd::get_new_handler() + 0x8F\nstart_thread + 0xD9\nclone + 0x43\n\nInvalidValueError occurred on worker 1: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638\ndecltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}>)())()) boost::leaf::leaf_detail::try_catch_<boost::leaf::context<vineyard::GSError const&, std::string const&, vineyard::GSError const&>, boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&, std::string const&)#3}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}>::type&&)::{lambda(vineyard::GSError const&)#4}>(grape::CommSpec const&, std::decay<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>::type&&)::{lambda()#1}, {lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}>(std::decay&, decltype (((declvalstd::decay)())())&&, {lambda()#2}&&, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}&&) + 0x31\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap() + 0x2AD\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragment() + 0x237\nvineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::LoadFragmentAsFragmentGroup() + 0x7B\nLoadGraph + 0x1A1D\ngs::GrapeInstance::loadGraph(gs::rpc::GSParams const&) + 0xA68\ngs::GrapeInstance::OnReceive(std::shared_ptrgs::CommandDetail) + 0xD63\ngs::Dispatcher::processCmd(std::shared_ptrgs::CommandDetail) + 0xD8\ngs::Dispatcher::subscriberLoop() + 0x11C\nstd::get_new_handler() + 0x8F\nstart_thread + 0xD9\nclone + 0x43\n\n"}"

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/gscoordinator/servicer/graphscope_one/service.py", line 245, in _RunStep
head, bodies = self._operation_executor.run_on_analytical_engine(
File "/usr/local/lib/python3.8/site-packages/gscoordinator/monitor.py", line 191, in runOnAnalyticalEngineWarp
res = func(instance, dag_def, dag_bodies, loader_op_bodies)
File "/usr/local/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 178, in run_on_analytical_engine
response_head, response_bodies = self.run_step(dag_def, dag_bodies)
File "/usr/local/lib/python3.8/site-packages/gscoordinator/op_executor.py", line 120, in run_step
raise AnalyticalEngineInternalError(msg)
graphscope.framework.errors.AnalyticalEngineInternalError: InvalidValueError occurred on worker 0: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in person table
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638
decltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&, int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2}, vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, st ... [truncated]

╭─────────────────────────────── Traceback (most recent call last) ────────────────────────────────╮
│ in :1 │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/framework/graph.py:1240 in load_from │
│ │
│ 1237 │ │ │ path = uri.scheme.split("+")[-1] + "://" + uri.netloc + uri.path │
│ 1238 │ │ │ if source == "graphar": │
│ 1239 │ │ │ │ _check_load_options(kwargs) │
│ ❱ 1240 │ │ │ │ return cls._load_from_graphar(path, sess, **kwargs) │
│ 1241 │ │ │ else: │
│ 1242 │ │ │ │ raise ValueError("Unknown source %s with uri $s:" % source, uri_str) │
│ 1243 │ │ else: │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/framework/graph.py:1190 in _load_from_graphar │
│ │
│ 1187 │ │ op = dag_utils.create_graph( │
│ 1188 │ │ │ sess.session_id, graph_def_pb2.ARROW_PROPERTY, inputs=[], attrs=config │
│ 1189 │ │ ) │
│ ❱ 1190 │ │ return sess._wrapper(GraphDAGNode(sess, op)) │
│ 1191 │ │
│ 1192 │ @classmethod
│ 1193 │ def load_from(cls, uri, sess=None, **kwargs): │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/session.py:831 in _wrapper │
│ │
│ 828 │ │
│ 829 │ def _wrapper(self, dag_node: DAGNode) -> Union[DAGNode, App, Context, Graph, Any]: │
│ 830 │ │ if self.eager(): │
│ ❱ 831 │ │ │ return self.run(dag_node) │
│ 832 │ │ return dag_node │
│ 833 │ │
│ 834 │ def run(self, fetches): │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/session.py:867 in run │
│ │
│ 864 │ │ gc.collect() │
│ 865 │ │ │
│ 866 │ │ with self._lock: │
│ ❱ 867 │ │ │ return self.run_fetches(fetches) │
│ 868 │ │
│ 869 │ def run_fetches(self, fetches): │
│ 870 │ │ """Run operations of fetches without the session lock.""" │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/session.py:877 in run_fetches │
│ │
│ 874 │ │ │ raise RuntimeError("Session disconnected.") │
│ 875 │ │ fetch_handler = _FetchHandler(self.dag, fetches) │
│ 876 │ │ try: │
│ ❱ 877 │ │ │ response = self._grpc_client.run(fetch_handler.targets) │
│ 878 │ │ except FatalError: │
│ 879 │ │ │ self.close() │
│ 880 │ │ │ raise │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/rpc.py:98 in run │
│ │
│ 95 │ │ return str(self) │
│ 96 │ │
│ 97 │ def run(self, dag_def): │
│ ❱ 98 │ │ return self._run_step_impl(dag_def) │
│ 99 │ │
│ 100 │ def fetch_logs(self): │
│ 101 │ │ if self._logs_fetching_thread is None: │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/utils.py:156 in with_grpc_catch │
│ │
│ 153 │ │ retries = 0 │
│ 154 │ │ while True: │
│ 155 │ │ │ try: │
│ ❱ 156 │ │ │ │ return fn(*args, **kwargs) │
│ 157 │ │ │ except grpc.RpcError as exc: │
│ 158 │ │ │ │ code = exc.code() │
│ 159 │ │ │ │ max_retries = GRPC_MAX_RETRIES_BY_CODE.get(code) │
│ │
│ /usr/local/lib/python3.8/site-packages/graphscope/client/rpc.py:199 in _run_step_impl │
│ │
│ 196 │ │ │ │ if isinstance(exc, tuple): │
│ 197 │ │ │ │ │ raise exc0 │
│ 198 │ │ │ │ else: │
│ ❱ 199 │ │ │ │ │ raise exc │
│ 200 │ │ return response │
│ 201 │ │
│ 202 │ def create_analytical_instance(self): │
╰──────────────────────────────────────────────────────────────────────────────────────────────────╯
AnalyticalEngineInternalError: InvalidValueError occurred on worker 0: /tmp/gs-local-deps/v6d-0.24.2/modules/graph/loader/gar_fragment_loader_impl.h:385: operator() -> vertex index column is not found in
person table
vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}::operator()(int) const + 0x638
decltype (((declval<boost::leaf::try_handle_some<vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&,
int&>(grape::CommSpec const&, std::decay&&, (std::decay<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>::type&&)...)::{lambda()#2},
vineyard::sync_gs_error<vineyard::GARFragmentLoader<long, unsigned long, vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}, vineyard::GARFragmentLoader<long, unsigned long,
vineyard::ArrowVertexMap>::constructVertexMap()::{lambda(int)#1}&>(grape::CommSpec const, grape::CommSpec const&, st ... [truncated]

@github-actions github-actions bot added the stale label Nov 12, 2024
Copy link
Contributor

/cc @yecol @sighingnow, this issus/pr has had no activity for a long time, please help to review the status and assign people to work on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant