Skip to content

Script: cr vars.sh

Tim L edited this page May 20, 2013 · 15 revisions
csv2rdf4lod-automation is licensed under the [Apache License, Version 2.0](https://github.com/timrdf/csv2rdf4lod-automation/wiki/License)

What is first

What we will cover

How to use cr-vars.sh

Let's get to it

cr-vars.sh shows all of the environment variables used to control the conversion automation, which are set by sourcing source-me.sh. You can also export for temporary tweaks.

[lebot@sam 2011-Feb-06]$ cr-vars.sh
--
CSV2RDF4LOD_HOME                                         /work/data-gov/v2010/csv2rdf4lod-automation
CSV2RDF4LOD_BASE_URI                                     http://logd.tw.rpi.edu
CSV2RDF4LOD_BASE_URI_OVERRIDE                            http://logd.tw.rpi.edu
--
CSV2RDF4LOD_CONVERT_MACHINE_URI                          http://tw.rpi.edu/web/inside/machine/sam#
CSV2RDF4LOD_CONVERT_PERSON_URI                           http://tw.rpi.edu/instances/TimLebo
--
CSV2RDF4LOD_CONVERT_NUMBER_EXAMPLE_ROWS                  25
CSV2RDF4LOD_CONVERT_EXAMPLE_SUBSET_ONLY                  (will default to: false)
CSV2RDF4LOD_CONVERT_DUMP_FILE_EXTENSIONS                 (no extension will be used)
CSV2RDF4LOD_CONVERT_PROVENANCE_GRANULAR                  (will default to: false)
CSV2RDF4LOD_CONVERT_DEBUG_LEVEL                          (will default to: none)
--
CSV2RDF4LOD_PUBLISH                                      (will default to: true)
CSV2RDF4LOD_PUBLISH_DELAY_UNTIL_ENHANCED                 false
CSV2RDF4LOD_PUBLISH_COMPRESS                             true
CSV2RDF4LOD_PUBLISH_OUR_SOURCE_ID                        twc-rpi-edu
CSV2RDF4LOD_PUBLISH_OUR_DATASET_ID                       dataset-conversion
CSV2RDF4LOD_PUBLISH_TTL                                  true
CSV2RDF4LOD_PUBLISH_TTL_LAYERS                           true
CSV2RDF4LOD_PUBLISH_NT                                   false
CSV2RDF4LOD_PUBLISH_RDFXML                               false
--
CSV2RDF4LOD_PUBLISH_SUBSET_VOID                          true
CSV2RDF4LOD_PUBLISH_SUBSET_VOID_NAMED_GRAPH              (will default to: auto)
CSV2RDF4LOD_PUBLISH_SUBSET_SAMEAS                        true
CSV2RDF4LOD_PUBLISH_SUBSET_SAMEAS_NAMED_GRAPH            (will default to: auto)
CSV2RDF4LOD_PUBLISH_SUBSET_SAMPLES                       true
--
CSV2RDF4LOD_PUBLISH_CONVERSION_PARAMS_NAMED_GRAPH        (will default to: auto)
--
CSV2RDF4LOD_PUBLISH_LOD_MATERIALIZATION                  false
CSV2RDF4LOD_PUBLISH_LOD_MATERIALIZATION_WWW_ROOT         /var/www/html/logd.tw.rpi.edu
CSV2RDF4LOD_PUBLISH_LOD_MATERIALIZATION_WRITE_FREQUENCY  (will default to: 1,000,000)
CSV2RDF4LOD_PUBLISH_LOD_MATERIALIZATION_REPORT_FREQUENCY (will default to: 1,000)
CSV2RDF4LOD_CONCURRENCY                                  2
--
CSV2RDF4LOD_PUBLISH_TDB                                  false
CSV2RDF4LOD_PUBLISH_TDB_DIR                              (will default to: VVV/publish/tdb/)
CSV2RDF4LOD_PUBLISH_TDB_INDIV                            false
--
CSV2RDF4LOD_PUBLISH_4STORE                               false
CSV2RDF4LOD_PUBLISH_4STORE_KB                            (will default to: csv2rdf4lod -- /var/lib/4store/csv2rdf4lod)
--
CSV2RDF4LOD_PUBLISH_VIRTUOSO                             false
--
CSV2RDF4LOD_PUBLISH_SPARQL_ENDPOINT                      false
CSV2RDF4LOD_PUBLISH_SPARQL_RESULTS_DIRECTORY             false
--
see documentation for variables in:
/work/data-gov/v2010/csv2rdf4lod-automation/bin/setup.sh

All

Running cr-vars.sh without arguments will show only the relevant environment variables. For example, if CSV2RDF4LOD_PUBLISH_VIRTUOSO is set to false, then it does not show CSV2RDF4LOD_PUBLISH_VIRTUOSO_PORT and the other details involved with publishing to a Virtuoso endpoint.

If you want to see all of the variables, use the --all argument to get an unabbreviated view of all variables that could ever be used by csv2rdf4lod-automation.

cr-vars.sh --all`

Dependency check

If things are good:

$ cr-vars.sh --check

[INFO]: rapper found

[INFO]: tdbloader and tdbquery found

If things are bad:

$ cr-vars.sh --check

[WARNING]: rapper not found on path. Publishing and many other things will fail.
           see https://github.com/timrdf/csv2rdf4lod-automation/wiki/Installing-csv2rdf4lod-automation---complete

[WARNING]: tdbloader not found on path. Unit testing with cr-test-conversion.sh will fail.
           see https://github.com/timrdf/csv2rdf4lod-automation/wiki/Script:-cr-test-conversion.sh
           see https://github.com/timrdf/csv2rdf4lod-automation/wiki/Installing-csv2rdf4lod-automation---complete

Note: The --check argument has been superseded by bin/util/install-csv2rdf4lod-dependencies.sh as part of https://github.com/timrdf/prizms.

See

Clone this wiki locally