[Bug]: CypherSyntaxError when storing Property Graph in Neo4j #16880
Comments
gideon772
added
bug
|
Hey @gideon772! I'm here to help you with any bugs, questions, or contributions you have. Let me know how I can assist you! A similar issue was reported in the LlamaIndex repository, where a In your case, the error message indicates a syntax issue with the Here's a general approach to address the issue:
By following these steps, you should be able to resolve the |
|
@dosu I'm using 5.20.0, then what is the issue, Should I need to update llama index version? |
|
Updating the LlamaIndex version might help resolve the issue, especially if there have been recent updates or bug fixes related to Neo4j integration. For instance, there have been updates in versions after 0.11.14 that address Neo4j integration issues, such as removing warnings from the dbms server in Neo4j queries and making Neo4j schema refresh configurable [1]. Consider updating to a newer version of LlamaIndex to see if it resolves the |
|
@dosu I think this query is the issue can you check and change Queryself.structured_query(
f"""
UNWIND $data AS row
MERGE (e:{BASE_NODE_LABEL} {{id: row.id}})
SET e += apoc.map.clean(row.properties, [], [])
SET e.name = row.name, e:`{BASE_ENTITY_LABEL}`
WITH e, row
CALL apoc.create.addLabels(e, [row.label])
YIELD node
WITH e, row
CALL (e, row) {{
WITH e, row
WHERE row.embedding IS NOT NULL
CALL db.create.setNodeVectorProperty(e, 'embedding', row.embedding)
RETURN count(*) AS count
}}
WITH e, row WHERE row.properties.triplet_source_id IS NOT NULL
MERGE (c:{BASE_NODE_LABEL} {{id: row.properties.triplet_source_id}})
MERGE (e)<-[:MENTIONS]-(c)
""",
param_map={"data": chunked_params},
) |
|
The issue in your query is with the self.structured_query(
f"""
UNWIND $data AS row
MERGE (e:{BASE_NODE_LABEL} {{id: row.id}})
SET e += apoc.map.clean(row.properties, [], [])
SET e.name = row.name, e:`{BASE_ENTITY_LABEL}`
WITH e, row
CALL apoc.create.addLabels(e, [row.label])
YIELD node
WITH e, row
WHERE row.embedding IS NOT NULL
CALL db.create.setNodeVectorProperty(e, 'embedding', row.embedding)
RETURN count(*) AS count
WITH e, row WHERE row.properties.triplet_source_id IS NOT NULL
MERGE (c:{BASE_NODE_LABEL} {{id: row.properties.triplet_source_id}})
MERGE (e)<-[:MENTIONS]-(c)
""",
param_map={"data": chunked_params},
)In this corrected version, the |
|
@dosu when I use this query getting |
|
The error you're encountering indicates that the variable self.structured_query(
f"""
UNWIND $data AS row
MERGE (e:{BASE_NODE_LABEL} {{id: row.id}})
SET e += apoc.map.clean(row.properties, [], [])
SET e.name = row.name, e:`{BASE_ENTITY_LABEL}`
WITH e, row
CALL apoc.create.addLabels(e, [row.label])
YIELD node
WITH e, row
WHERE row.embedding IS NOT NULL
CALL db.create.setNodeVectorProperty(e, 'embedding', row.embedding)
WITH e, row // Add this line to carry forward the variables
RETURN count(*) AS count
WITH e, row WHERE row.properties.triplet_source_id IS NOT NULL
MERGE (c:{BASE_NODE_LABEL} {{id: row.properties.triplet_source_id}})
MERGE (e)<-[:MENTIONS]-(c)
""",
param_map={"data": chunked_params},
)By adding a |
Bug Description
Hi,
When attempting to store a Property Graph in a Neo4j database, I have encountered a
CypherSyntaxErrorwith the messageInvalid input '(': expected "{" (line 10, column 26 (offset: 402)).Llama Index Versions
Still, the graph was generated successfully.
Generation Status
When I tried to generate without graph store, it worked and I saved the graph using
graph_index.property_graph_store.save_networkx_graph(name=f"./KB_TEST_1.html")Help me to solve this issue, Thanks in advance 💯
Version
llama-index-core=0.11.14
Steps to Reproduce
Steps to Reproduce
Sample Document Structure
Config
Graph Store Intialization
Graph Generation Code
Relevant Logs/Tracbacks
{ "name": "CypherSyntaxError", "message": "{code: Neo.ClientError.Statement.SyntaxError} {message: Invalid input '(': expected \"{\" (line 10, column 26 (offset: 402)) \" CALL (e, row) {\" ^}", "stack": "--------------------------------------------------------------------------- CypherSyntaxError Traceback (most recent call last) Cell In[14], line 10 2 from llama_index.core.indices.property_graph.transformations import SimpleLLMPathExtractor, ImplicitPathExtractor 5 kg_extractor = [ 6 SimpleLLMPathExtractor(max_paths_per_chunk=100), 7 ImplicitPathExtractor() 8 ] ---> 10 graph_index = PropertyGraphIndex.from_documents( 11 documents, 12 show_progress=True, 13 embed_model=HuggingFaceEmbedding(), 14 kg_extractors=kg_extractor, 15 llm=llm, 16 property_graph_store=graph_store) 18 # graph_index.property_graph_store.save_networkx_graph(name=f\"./KB_TEST_1.html\") File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/base.py:119, in BaseIndex.from_documents(cls, documents, storage_context, show_progress, callback_manager, transformations, **kwargs) 110 docstore.set_document_hash(doc.get_doc_id(), doc.hash) 112 nodes = run_transformations( 113 documents, # type: ignore 114 transformations, 115 show_progress=show_progress, 116 **kwargs, 117 ) --> 119 return cls( 120 nodes=nodes, 121 storage_context=storage_context, 122 callback_manager=callback_manager, 123 show_progress=show_progress, 124 transformations=transformations, 125 **kwargs, 126 ) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/property_graph/base.py:134, in PropertyGraphIndex.__init__(self, nodes, llm, kg_extractors, property_graph_store, vector_store, use_async, embed_model, embed_kg_nodes, callback_manager, transformations, storage_context, show_progress, **kwargs) 128 self._embed_kg_nodes = embed_kg_nodes 129 self._override_vector_store = ( 130 vector_store is not None 131 or not storage_context.property_graph_store.supports_vector_queries 132 ) --> 134 super().__init__( 135 nodes=nodes, 136 callback_manager=callback_manager, 137 storage_context=storage_context, 138 transformations=transformations, 139 show_progress=show_progress, 140 **kwargs, 141 ) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/base.py:77, in BaseIndex.__init__(self, nodes, objects, index_struct, storage_context, callback_manager, transformations, show_progress, **kwargs) 75 if index_struct is None: 76 nodes = nodes or [] ---> 77 index_struct = self.build_index_from_nodes( 78 nodes + objects, # type: ignore 79 **kwargs, # type: ignore 80 ) 81 self._index_struct = index_struct 82 self._storage_context.index_store.add_index_struct(self._index_struct) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/base.py:185, in BaseIndex.build_index_from_nodes(self, nodes, **build_kwargs) 183 \"\"\"Build the index from nodes.\"\"\" 184 self._docstore.add_documents(nodes, allow_update=True) --> 185 return self._build_index_from_nodes(nodes, **build_kwargs) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/property_graph/base.py:334, in PropertyGraphIndex._build_index_from_nodes(self, nodes, **build_kwargs) 330 def _build_index_from_nodes( 331 self, nodes: Optional[Sequence[BaseNode]], **build_kwargs: Any 332 ) -> IndexLPG: 333 \"\"\"Build index from nodes.\"\"\" --> 334 nodes = self._insert_nodes(nodes or []) 336 # this isn't really used or needed 337 return IndexLPG() File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/core/indices/property_graph/base.py:296, in PropertyGraphIndex._insert_nodes(self, nodes) 293 self.property_graph_store.upsert_llama_nodes(nodes) 295 if len(kg_nodes_to_insert) > 0: --> 296 self.property_graph_store.upsert_nodes(kg_nodes_to_insert) 298 # important: upsert relations after nodes 299 if len(kg_rels_to_insert) > 0: File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/graph_stores/neo4j/neo4j_property_graph.py:334, in Neo4jPropertyGraphStore.upsert_nodes(self, nodes) 332 for index in range(0, len(entity_dicts), CHUNK_SIZE): 333 chunked_params = entity_dicts[index : index + CHUNK_SIZE] --> 334 self.structured_query( 335 f\"\"\" 336 UNWIND $data AS row 337 MERGE (e:{BASE_NODE_LABEL} {{id: row.id}}) 338 SET e += apoc.map.clean(row.properties, [], []) 339 SET e.name = row.name, e:`{BASE_ENTITY_LABEL}` 340 WITH e, row 341 CALL apoc.create.addLabels(e, [row.label]) 342 YIELD node 343 WITH e, row 344 CALL (e, row) {{ 345 WITH e, row 346 WHERE row.embedding IS NOT NULL 347 CALL db.create.setNodeVectorProperty(e, 'embedding', row.embedding) 348 RETURN count(*) AS count 349 }} 350 WITH e, row WHERE row.properties.triplet_source_id IS NOT NULL 351 MERGE (c:{BASE_NODE_LABEL} {{id: row.properties.triplet_source_id}}) 352 MERGE (e)<-[:MENTIONS]-(c) 353 \"\"\", 354 param_map={\"data\": chunked_params}, 355 ) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/llama_index/graph_stores/neo4j/neo4j_property_graph.py:587, in Neo4jPropertyGraphStore.structured_query(self, query, param_map) 585 param_map = param_map or {} 586 try: --> 587 data, _, _ = self._driver.execute_query( 588 query, database_=self._database, parameters_=param_map 589 ) 590 full_result = [d.data() for d in data] 592 if self.sanitize_query_output: File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/driver.py:971, in Driver.execute_query(self, query_, parameters_, routing_, database_, impersonated_user_, bookmark_manager_, auth_, result_transformer_, **kwargs) 967 raise ValueError( 968 f\"Invalid routing control value: {routing_!r}\" 969 ) 970 with session._pipelined_begin: --> 971 return session._run_transaction( 972 access_mode, 973 TelemetryAPI.DRIVER, 974 work, 975 (query_str, parameters, result_transformer_), 976 {}, 977 ) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/work/session.py:574, in Session._run_transaction(self, access_mode, api, transaction_function, args, kwargs) 572 tx = self._transaction 573 try: --> 574 result = transaction_function(tx, *args, **kwargs) 575 except asyncio.CancelledError: 576 # if cancellation callback has not been called yet: 577 if self._transaction is not None: File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/driver.py:1307, in _work(tx, query, parameters, transformer) 1301 def _work( 1302 tx: ManagedTransaction, 1303 query: te.LiteralString, 1304 parameters: dict[str, t.Any], 1305 transformer: t.Callable[[Result], t.Union[_T]], 1306 ) -> _T: -> 1307 res = tx.run(query, parameters) 1308 return transformer(res) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/work/transaction.py:195, in TransactionBase.run(self, query, parameters, **kwparameters) 192 self._results.append(result) 194 parameters = dict(parameters or {}, **kwparameters) --> 195 result._tx_ready_run(query, parameters) 197 return result File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/work/result.py:175, in Result._tx_ready_run(self, query, parameters) 171 def _tx_ready_run(self, query, parameters): 172 # BEGIN+RUN does not carry any extra on the RUN message. 173 # BEGIN {extra} 174 # RUN \"query\" {parameters} {extra} --> 175 self._run(query, parameters, None, None, None, None, None, None) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/work/result.py:231, in Result._run(self, query, parameters, db, imp_user, access_mode, bookmarks, notifications_min_severity, notifications_disabled_classifications) 229 self._pull() 230 self._connection.send_all() --> 231 self._attach() File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/work/result.py:425, in Result._attach(self) 423 if self._exhausted is False: 424 while self._attached is False: --> 425 self._connection.fetch_message() File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/io/_common.py:181, in ConnectionErrorHandler.__getattr__.<locals>.outer.<locals>.inner(*args, **kwargs) 179 def inner(*args, **kwargs): 180 try: --> 181 func(*args, **kwargs) 182 except (Neo4jError, ServiceUnavailable, SessionExpired) as exc: 183 assert not asyncio.iscoroutinefunction(self.__on_error) File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/io/_bolt.py:977, in Bolt.fetch_message(self) 973 # Receive exactly one message 974 tag, fields = self.inbox.pop( 975 hydration_hooks=self.responses[0].hydration_hooks 976 ) --> 977 res = self._process_message(tag, fields) 978 self.idle_since = monotonic() 979 return res File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/io/_bolt5.py:466, in Bolt5x0._process_message(self, tag, fields) 464 self._server_state_manager.state = self.bolt_states.FAILED 465 try: --> 466 response.on_failure(summary_metadata or {}) 467 except (ServiceUnavailable, DatabaseUnavailable): 468 if self.pool: File ~/.virtualenvs/ameya-service-database/lib/python3.11/site-packages/neo4j/_sync/io/_common.py:251, in Response.on_failure(self, metadata) 249 handler = self.handlers.get(\"on_summary\") 250 Util.callback(handler) --> 251 raise Neo4jError.hydrate(**metadata) CypherSyntaxError: {code: Neo.ClientError.Statement.SyntaxError} {message: Invalid input '(': expected \"{\" (line 10, column 26 (offset: 402)) \" CALL (e, row) {\" ^}" }The text was updated successfully, but these errors were encountered: