Getting java null pointer exception due to malformed data in any property of nodes or edges #4142

ibtesamlatif2997 · 2023-11-28T09:26:52Z

ibtesamlatif2997
Nov 28, 2023

Please include configurations and logs if available.

For confirmed bugs, please report:

Version: 1.0.0
Storage Backend: Cassandra
Mixed Index Backend: Elasticsearch
Link to discussed bug:
Expected Behavior:

If there is any corrupted node or edge. I should be able to delete it and recreate it and following queries should work on that node

g.V(id).drop().iterate()
g.V(id).valueMap()
g.V(id).properties("is_deleted").drop()

Current Behavior:

When there is a malformed value in any property in the node or edge. I am getting null pointer exception and because of that issue I can't delete that node and can't modify that node and unable to traverse on other nodes when this kind of node came in traversing. The problem is that I am dealing with big data and now due to some problematic nodes I am getting null pointer exception error on getting data and there is no way to delete the node and recreate it or modify the properies. Please I need help as I don't want to delete whole data and run my ETL jobs again

g.V(id).drop().iterate() gives null pointer exception
g.V(id).valueMap() gives null pointer exception
g.V(id).properties("is_deleted").drop() gives null pointer exception

Steps to Reproduce:

I have the property is_deleted of type boolean. I saved the property value for one node as true (boolean)
Run command g.V(id).valueMap() will show all properties of that node
Now for the same node add value of is_deleted as "true" (string).
Run command g.V(id).valueMap(). Now i am getting null pointer exception
I can't delete this node, can't delete the property of that node, and cant modify the value of is_deleted to make it correct
g.V(id).drop().iterate() gives null pointer exception
g.V(id).valueMap() gives null pointer exception
g.V(id).properties("is_deleted").drop() gives null pointer exception

Stack Trace (if you have one)

    'stackTrace' => 'java.lang.NullPointerException\n' +
      '\tat org.janusgraph.graphdb.database.EdgeSerializer.parseRelation(EdgeSerializer.java:115)\n' +
      '\tat org.janusgraph.graphdb.database.EdgeSerializer.readRelation(EdgeSerializer.java:83)\n' +
      '\tat org.janusgraph.graphdb.transaction.RelationConstructor.readRelation(RelationConstructor.java:70)\n' +
      '\tat org.janusgraph.graphdb.transaction.RelationConstructor$1.next(RelationConstructor.java:57)\n' +
      '\tat org.janusgraph.graphdb.transaction.RelationConstructor$1.next(RelationConstructor.java:45)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.FlatMapStep.processNextStart(FlatMapStep.java:45)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.FlatMapStep.processNextStart(FlatMapStep.java:48)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.filter.FilterStep.processNextStart(FilterStep.java:40)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.SelectOneStep.processNextStart(SelectOneStep.java:58)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.janusgraph.graphdb.tinkerpop.optimize.step.JanusGraphMultiQueryStep.processNextStart(JanusGraphMultiQueryStep.java:111)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.hasNext(ExpandableStepIterator.java:47)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.NoOpBarrierStep.processAllStarts(NoOpBarrierStep.java:67)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.NoOpBarrierStep.processNextStart(NoOpBarrierStep.java:56)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.ScalarMapStep.processNextStart(ScalarMapStep.java:39)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.SelectOneStep.processNextStart(SelectOneStep.java:58)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.janusgraph.graphdb.tinkerpop.optimize.step.JanusGraphMultiQueryStep.processNextStart(JanusGraphMultiQueryStep.java:111)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.hasNext(ExpandableStepIterator.java:47)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.NoOpBarrierStep.processAllStarts(NoOpBarrierStep.java:67)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.NoOpBarrierStep.processNextStart(NoOpBarrierStep.java:56)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.ScalarMapStep.processNextStart(ScalarMapStep.java:39)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.next(ExpandableStepIterator.java:55)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.map.SelectStep.processNextStart(SelectStep.java:68)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:155)\n' +
      '\tat org.apache.tinkerpop.gremlin.process.traversal.util.DefaultTraversal.hasNext(DefaultTraversal.java:192)\n' +
      '\tat org.apache.tinkerpop.gremlin.server.op.AbstractOpProcessor.handleIterator(AbstractOpProcessor.java:98)\n' +
      '\tat org.apache.tinkerpop.gremlin.server.op.AbstractEvalOpProcessor.lambda$evalOpInternal$6(AbstractEvalOpProcessor.java:267)\n' +
      '\tat org.apache.tinkerpop.gremlin.groovy.engine.GremlinExecutor.lambda$eval$0(GremlinExecutor.java:283)\n' +
      '\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n' +
      '\tat java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)\n' +
      '\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n' +
      '\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n' +
      '\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n' +
      '\tat java.base/java.lang.Thread.run(Thread.java:829)\n',
    'exceptions' => [ 'java.lang.NullPointerException' ]
  }
}

ibtesamlatif2997 · 2023-11-28T09:32:00Z

ibtesamlatif2997
Nov 28, 2023
Author

@porunov Please brother it will be great if you can help me

0 replies

li-boxuan · 2023-11-29T06:25:53Z

li-boxuan
Nov 29, 2023
Maintainer

Have you tried #1099 (comment)?

3 replies

ibtesamlatif2997 Nov 30, 2023
Author

Yes, I am even adding data to nodes again but still unable to delete them, getting null pointer exception

li-boxuan Nov 30, 2023
Maintainer

Is is_deleted property indexed?

li-boxuan Nov 30, 2023
Maintainer

Just to make sure, how do you know your data is malformed?

g.V(id).drop().iterate() gives null pointer exception this doesn't tell us the node is malformed. You could see null pointer exception simply because that node doesn't exist.

What's the symptom? g.V().has("is_deleted", true) returns data but those vertices couldn't be dropped?

ibtesamlatif2997 · 2023-11-30T17:32:07Z

ibtesamlatif2997
Nov 30, 2023
Author

Yes, reindexed property

…

On Thu, 30 Nov 2023, 9:29 pm Boxuan Li, ***@***.***> wrote: Is is_deleted property indexed? — Reply to this email directly, view it on GitHub <#4142 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADZYKQEBHTKHLDUIM5LK7ZDYHC7A3AVCNFSM6AAAAABABCGLE2VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TOMRQGYZDA> . You are receiving this because you authored the thread.Message ID: ***@***.***>

0 replies

ibtesamlatif2997 · 2023-11-30T18:19:19Z

ibtesamlatif2997
Nov 30, 2023
Author

The property dattype is boolean. For same node I saved the value in boolean ( true ) and it was working fine after that i saved that value in string ( "true" ) This issue I have reproduced it. But in production I faced this issue due to data types issues.

…

On Thu, 30 Nov 2023, 9:34 pm Boxuan Li, ***@***.***> wrote: Just to make sure, how do you know your data is malformed? g.V(id).drop().iterate() gives null pointer exception this doesn't tell us the node is malformed. You could see null pointer exception simply because that node doesn't exist. What's the symptom? g.V().has("is_deleted", true) returns data but those vertices couldn't be dropped? — Reply to this email directly, view it on GitHub <#4142 (reply in thread)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADZYKQFUT27SB7LVWHVOVB3YHC7RTAVCNFSM6AAAAABABCGLE2VHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM3TOMRQGY3TE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

0 replies

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Getting java null pointer exception due to malformed data in any property of nodes or edges #4142

{{title}}

Replies: 4 comments 3 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Getting java null pointer exception due to malformed data in any property of nodes or edges #4142

ibtesamlatif2997 Nov 28, 2023

Stack Trace (if you have one)

Replies: 4 comments · 3 replies

ibtesamlatif2997 Nov 28, 2023 Author

li-boxuan Nov 29, 2023 Maintainer

ibtesamlatif2997 Nov 30, 2023 Author

li-boxuan Nov 30, 2023 Maintainer

li-boxuan Nov 30, 2023 Maintainer

ibtesamlatif2997 Nov 30, 2023 Author

ibtesamlatif2997 Nov 30, 2023 Author

ibtesamlatif2997
Nov 28, 2023

Replies: 4 comments 3 replies

ibtesamlatif2997
Nov 28, 2023
Author

li-boxuan
Nov 29, 2023
Maintainer

ibtesamlatif2997 Nov 30, 2023
Author

li-boxuan Nov 30, 2023
Maintainer

li-boxuan Nov 30, 2023
Maintainer

ibtesamlatif2997
Nov 30, 2023
Author

ibtesamlatif2997
Nov 30, 2023
Author