Data Management Plan
GUID: gov.noaa.nmfs.inport:49816 | Published / External
Data Management Plan
DMP Template v2.0.1 (2015-01-01)
Please provide the following information, and submit to the NOAA DM Plan Repository.Reference to Master DM Plan (if applicable)
As stated in Section IV, Requirement 1.3, DM Plans may be hierarchical. If this DM Plan inherits provisions from a higher-level DM Plan already submitted to the Repository, then this more-specific Plan only needs to provide information that differs from what was provided in the Master DM Plan.
1. General Description of Data to be Managed
This metadata record describes the acquisition and
processing of bare earth lidar data, raw point cloud lidar
data, lidar intensity data, and floodmap breaklines
consisting of a total of 280 sheets for Camp Shelby, MS.
The post-spacing for this project is 3-meter. This project
was broken into 3 parts, Acquisition, Part A Processing,
and Part B Processing. Acquisition was tasked by
Mississippi Geographic Information, LLC (MGI); Work
Order No. ED-5. Part A Processing was tasked by MGI;
Work Order No. ED-7. Part B Processing was tasked by
MGI; Work Order No. ED-8. EarthData International, Inc.
(EarthData) is a member of MGI and was authorized to
undertake this project in accordance with the terms and
conditions of the Professional Services Agreement
between MGI and the Mississippi Department of
Environmental Quality (MDEQ), dated February 17, 2004,
and in accordance with MGI Task Order No. 18a.
This project is being delivered to the City of Hattiesburg,
Camp Shelby, USGS, and MDEQ.
Products developed for the City of Hattiesburg (City of
1. Final lidar data georeferenced to MS State Plane East
Zone, NAD83, NAVD88, US Survey foot
2. Bare earth lidar data in ASCII format and LAS format
3. Raw point cloud lidar data in LAS format
4. Lidar intensity data in TIF format
5. Digital flight line index in ESRI-compatible format
6. Survey control report
7. Lidar processing report
Products developed for Camp Shelby (Part A) include the
1. Final lidar data georeferenced to UTM Zone 16 North,
NAD83, NAVD88, meters
2. Bare earth lidar data in ASCII format and LAS format
3. Raw point cloud lidar data in LAS format
4. Lidar intensity data in TIF format
5. Digital flight line index in ESRI-compatible format
6. Survey control report
7. Lidar processing report
Products developed for USGS (Part A and Part B) include
1. Final lidar data georeferenced to MS State Plane East
Zone, NAD83, NAVD88, US Survey foot
2. Bare earth lidar data in ASCII format and LAS format
3. Raw point cloud lidar data in LAS format
4. Lidar intensity data in TIF format
5. Digital flight line index in ESRI-compatible format
6. Survey control report
7. Lidar processing report
Products developed for MDEQ (Part A and Part B) include
1. Final lidar data georeferenced to MS State Plane East
Zone, NAD83, NAVD88, US Survey foot
2. Bare earth lidar data in ASCII format and LAS format
3. Raw point cloud lidar data in LAS format
4. Lidar intensity data in TIF format
5. Floodmap breaklines in ESRI shapefile format
6. Digital flight line index in ESRI-compatible format
7. Survey control report
8. Lidar processing report
Original contact information:
Contact Name: Angela Worley
Contact Org: EarthData International, Inc.
Title: Project Manager
Phone: 301-948-8550 x222
Email: aworley@earthdata.com
Notes: Only a maximum of 4000 characters will be included.
Notes: Data collection is considered ongoing if a time frame of type "Continuous" exists.
Notes: All time frames from all extent groups are included.
Notes: All geographic areas from all extent groups are included.
(e.g., digital numeric data, imagery, photographs, video, audio, database, tabular data, etc.)
(e.g., satellite, airplane, unmanned aerial system, radar, weather station, moored buoy, research vessel, autonomous underwater vehicle, animal tagging, manual surveys, enforcement activities, numerical model, etc.)
2. Point of Contact for this Data Management Plan (author or maintainer)
Notes: The name of the Person of the most recent Support Role of type "Metadata Contact" is used. The support role must be in effect.
Notes: The name of the Organization of the most recent Support Role of type "Metadata Contact" is used. This field is required if applicable.
3. Responsible Party for Data Management
Program Managers, or their designee, shall be responsible for assuring the proper management of the data produced by their Program. Please indicate the responsible party below.
Notes: The name of the Person of the most recent Support Role of type "Data Steward" is used. The support role must be in effect.
4. Resources
Programs must identify resources within their own budget for managing the data they produce.
5. Data Lineage and Quality
NOAA has issued Information Quality Guidelines for ensuring and maximizing the quality, objectivity, utility, and integrity of information which it disseminates.
(describe or provide URL of description):
Process Steps:
- 2007-02-15 00:00:00 - EarthData has developed a unique method for processing lidar data to identify and remove elevation points falling on vegetation, buildings, and other above ground structures. The algorithms for filtering data were utilized within EarthData's proprietary software and commercial software written by TerraSolid. This software suite of tools provides efficient processing for small to large-scale, projects and has been incorporated into ISO 9001 compliant production work flows. The following is a 1. The technician performs calibrations on the data set. 2. The technician performed a visual inspection of the data to verify that the flight lines overlap correctly. The technician also verified that there were no voids, and that the data covered the project limits. The technician then selected a series of areas from the data set and inspected them where adjacent flight lines overlapped. These overlapping areas were merged and a process which utilizes 3-D Analyst and EarthData's proprietary software was run to detect and color code the differences in elevation values and profiles. The technician reviewed these plots and located the areas that contained systematic errors or distortions that were introduced by the lidar sensor. 3. Systematic distortions highlighted in step 2 were removed and the data was re-inspected. Corrections and adjustments can involve the application of angular deflection or compensation for curvature of the ground surface that can be introduced by crossing from one type of land cover to another. 4. The lidar data for each flight line was trimmed in batch for the removal of the overlap areas between flight lines. The data was checked against a control network to ensure that vertical requirements were maintained. Conversion to the client-specified datum and projections were then completed. The lidar flight line data sets were then segmented into adjoining tiles for batch processing and data management. 5. The initial batch-processing run removed 95% of points falling on vegetation. The algorithm also removed the points that fell on the edge of hard features such as structures, elevated roadways and bridges. 6. The operator interactively processed the data using lidar editing tools. During this final phase the operator generated a TIN based on a desired thematic layers to evaluate the automated classification performed in step 5. This allowed the operator to quickly re-classify points from one layer to another and recreate the TIN surface to see the effects of edits. Geo-referenced images were toggled on or off to aid the operator in identifying problem areas. The data was also examined with an automated profiling tool to aid the operator in the reclassification. 7. The final bare earth was written to an LAS 1.0 format and also converted to ASCII. 8. The point cloud data were delivered in LAS 1.0 format.
- 2007-02-15 00:00:00 - EarthData utilizes a combination of proprietary and COTS processes to generate intensity images from the lidar data. Intensity images are generated from the full points cloud (minus noise points) and the pixel width is typically matched to the post spacing of the lidar data to achieve the best resolution. The following steps are used to 1. Lidar point cloud is tiled to the deliverable tile layout. 2. All noise points, spikes, and wells are deleted out of the tiles. 3. An EarthData proprietary piece of software, EEBN2TIF is then used to process out the intensity values of the lidar. At this point, the pixel size is selected based on best fit or to match the client specification if noted in the SOW. 4. The software then generates TIF and TFW files for each tile. 5. ArcView is used to review and QC the tiles before delivery. 6. The lidar intensity data were delivered in TIF format.
- 2013-09-22 00:00:00 - The NOAA Office for Coastal Management (OCM) received topographic files in .LAZ format. The files contained lidar elevation and intensity measurements. The data were received in Mississippi State Plane East (2301, feet) and NAVD88 vertical datum (feet). OCM performed the following processing for data storage and Digital Coast provisioning purposes: 1. The topographic laz files were converted from orthometric (NAVD88) heights to ellipsoidal heights using Geoid09. 2. The topographic laz files were transformed from MS-SP 2301 to a Geographic Coordinate system (NAD83). 3. The topographic laz files were cleaned of high (460 m) and low (0 m) error points and variable length records (vlr) were removed. 4. The topographic las files' horizontal units were converted from feet to decimal degrees.
(describe or provide URL of description):
6. Data Documentation
The EDMC Data Documentation Procedural Directive requires that NOAA data be well documented, specifies the use of ISO 19115 and related standards for documentation of new data, and provides links to resources and tools for metadata creation and validation.
Missing/invalid information:
- 1.7. Data collection method(s)
- 3.1. Responsible Party for Data Management
- 4.1. Have resources for management of these data been identified?
- 4.2. Approximate percentage of the budget for these data devoted to data management
- 5.2. Quality control procedures employed
- 7.1. Do these data comply with the Data Access directive?
- 7.1.1. If data are not available or has limitations, has a Waiver been filed?
- 7.1.2. If there are limitations to data access, describe how data are protected
- 7.4. Approximate delay between data collection and dissemination
- 8.1. Actual or planned long-term data archive location
- 8.3. Approximate delay between data collection and submission to an archive facility
- 8.4. How will the data be protected from accidental or malicious modification or deletion prior to receipt by the archive?
(describe or provide URL of description):
7. Data Access
NAO 212-15 states that access to environmental data may only be restricted when distribution is explicitly limited by law, regulation, policy (such as those applicable to personally identifiable information or protected critical infrastructure information or proprietary trade information) or by security requirements. The EDMC Data Access Procedural Directive contains specific guidance, recommends the use of open-standard, interoperable, non-proprietary web services, provides information about resources and tools to enable data access, and includes a Waiver to be submitted to justify any approach other than full, unrestricted public access.
None
Notes: The name of the Organization of the most recent Support Role of type "Distributor" is used. The support role must be in effect. This information is not required if an approved access waiver exists for this data.
Notes: This field is required if a Distributor has not been specified.
https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid18/2563/index.html
Notes: All URLs listed in the Distribution Info section will be included. This field is required if applicable.
This data can be obtained on-line at the following URL:
https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=2563
;
Notes: This field is required if applicable.
8. Data Preservation and Protection
The NOAA Procedure for Scientific Records Appraisal and Archive Approval describes how to identify, appraise and decide what scientific records are to be preserved in a NOAA archive.
(Specify NCEI-MD, NCEI-CO, NCEI-NC, NCEI-MS, World Data Center (WDC) facility, Other, To Be Determined, Unable to Archive, or No Archiving Intended)
Notes: This field is required if archive location is World Data Center or Other.
Notes: This field is required if archive location is To Be Determined, Unable to Archive, or No Archiving Intended.
Notes: Physical Location Organization, City and State are required, or a Location Description is required.
Discuss data back-up, disaster recovery/contingency planning, and off-site data storage relevant to the data collection
9. Additional Line Office or Staff Office Questions
Line and Staff Offices may extend this template by inserting additional questions in this section.