TC & DND AIS Discussion, July 26, 2019
- Jiehua Yi (Unlicensed)
Meeting Organizer: Mohamed Mohamed
Participant Groups: Strategic Program Policy, Transportation Economic Analysis/Policy, Data Analytics, eGIS, 8 people.
DND contact: Scott Syms
Agenda:
1. Introduction/roundtable
2. Overview of TC’s AIS uses
3. Scope of the DND/TCS AIS dataset MOU
4. Requirement for archival dataset(10 years)
5. Requirement of real-time, near real-time/ data stream
6. DND’s capacity to support TC’s ongoing operational needs
7. Closing remarks and next steps
Gathered the following related to us:
1. AIS is unclassified data
2. There won't be a historical data link provided by DND. Historical data will be provided by TC, basically TC made a copy of the 10GB raw data of the past 10 years from DND.
3. Public facing web mapping application based on AIS data is not allowed and it has to be discussed with the data owner, according to Scott.
4. Does FGP need this AIS data? A question to the board of FGP.
5. All the data types, e.g., coastal AIS, spatial AIS, LRIT, INNAV etc. are located in one table.
6. Data duplications exist. DND has improved the data from 30% error to 10% error by doing string matching already.
7. (Presented to the table, need more discussion with Mohamed's team) eGIS project has some options to work with AIS data, e.g., directly consume the DND data link on-the-fly, without any storage. While for the historical data, as we have purchased GeoEvent Server, it has its own big data store, which may have confliction with Mohamed team's data lake.