Vessel-Generated Vessel monitoring system (VMS) form data

Many industry participants are required to send to NMFS electronically submitted forms pertaining to their fishing trips. These forms are ususally sent from a device on the fishing vessel itself and transmitted via satellite to the vendor of that particular device. These forms contain a variety of data, including the time that it was submitted, the latitude and longitude of the fishing vessel, the operator's permit number, the vessel trip report number and, depending on the type of report, such additional data as the landing port city and state, estimated arrival date/time, estimated offload date/time and the pounds of each species caught, etc. (See OLE's Forms Requirements document for details.)

The forms messages are sent to GARFO through one of several methods, depending on the vendor. These methods include FTP, email and Amazon DropBox. When GARFO receives these messages, they are stored in a raw input table. Every 5 minutes, a cron job runs the VMS Parsing Engine, which parses and validates the data in the most recently received messages. Parsed messages are stored in the output table for the given form type. Data errors are logged in a data_error table and reviewed by OLE, which determines what action, if any, needs to be taken. Parsing errors are logged and resolved by the application developer. The output table data are then prepared for use in GARFO's production systems, including its industry-accesible web site, through a staging area managed by Denise Washick.

The VMS data may be used by the fishery regulatory staff, statistical staff or the Office of Law Enforcement. The data are an important tool for ensuring compliance with fishery regulations.

The VMS Parsing Engine parses and performs a series of validation checks on the submitted form data to ensure that the forms have been correctly filled out. If there are any errors in the data, the VMS message is marked as having a data error and OLE staff can then determine how to resolve it. Messages without data errors are inserted into an output table, from where the data will eventually be accessible on the web site and available for GARFO staff who need to perform additional processing with it.

Since regulatory requirements and the csv list of the forms change often, there are several versions of the parsing engine.

3rd Floor Server Room

All fishing industry related data managed by IRM is considered to be business confidential and may not be released without written consent of the data originator.

Access to data is governed by 50CFR600 - Confidentiality of Information. Access by state fishery management agency staff and Fisheries Management Council staff may be allowed through Memorandum of Understanding that are signed by the Greater Atlantic Regional Administrator and Directors of the State Agency or Councils that describe the need and uses of the data and list the individuals who will have access to the data. Contractors may be granted access provided they are working under contract to NOAA or a cooperating partner (state, Council, Commission) on a specific project under the oversight of a partner.

Access is restricted to personnel authorized in accordance with NOAA Administrative Order 216-100. A signed non-disclosure agreement must be on file for all authorized personnel. The IRM help desk or APSD Data Request staff are the POC for non-disclosure forms.

Relational database.

NA

NA

NA

NA

NA

NA

NA

NA

NA

NA

NA

NA

NA

NA