Loading Data into an ODM Database

One of a data manager's tasks is to load data into an ODM database, and check that the data loaded correctly and is valid. Here is info on tools and techniques that are useful in that process:

• Information and Downloads on ODM Databases

• Tools that can be used to load data into an ODM database:
  • ODM Data Loader— an application for loading data from simple text or spreadsheet files into an ODM database.
  • ODM Streaming Data Loader (SDL)— a tool for for streaming continuously measured sensor data into an ODM database. The Streaming Data Loader takes as input datalogger files and loads them into ODM in near real time as they are updated by a telemetry system.
  • SQL Server Management Studio
  • Microsoft Excel/Microsoft Access
  • SQL Server Integration Service (SSIS)
  • Many other tools can import data into an ODM SQL Server database, so this list is not exclusive
• Other tools that can be useful as part of the loading process:
  • ODM Tools— an application that allows data managers and ODM users to query, export, visualize, summarize, and edit data that is stored in an ODM database.
  • Updating the Master Controlled Vocabulary System— promotes consistency between different instances of the ODM through a moderated system for requesting changes to the master ODM controlled vocabularies. Once changes are accepted, ODM tools provides functionality to reconcile local controlled vocabularies in local ODM instances with master controlled vocabularies.
• Once the data is loaded, they have been transformed from whatever state they were in, to a standardized format with standardized descriptors in our ODM. Be aware that different sources may be more or less sensitive to their data being "transformed" and information on this should become part of its provenance.

Other Data Managment/Maintenance Topics

• General Data Management
• Updating the Master Controlled Vocabulary System