Data Management Plan

Towill collected approximately 75 square miles of coast in Oregon, 486 square miles of coast in Washington and California, and an additional 44 square miles for USACE defined harbors. The data was collected in a corridor approximately 500 meters wide. The nominal pulse spacing for this project was 1 point every 0.35 meters. Dewberry used proprietary procedures to classify the LAS according to project specifications: 0-Never Classified, 1-Unclassified, 2-Ground, 7-Low Noise, 9-Water, 10-Ignored Ground due to breakline proximity, 17- Bridges, 18-High Noise, 64- Flown Outside of Low Tide Window and 65- Temporal Ground. Dewberry produced 3D breaklines and combined these with the final LiDAR data to produce seamless DEMs for the project area. The data was formatted according to the USNG tile naming convention with each tile covering an area of 1,500 meters by 1,500 meters. A total of 2377 UTM 10 DEM and LAS tiles and 487 UTM 11 DEM and LAS tiles were produced for the project.

Original contact information:

Contact Org: USGS

Title: Program Manager

Phone: (303) 202-4419

Email: kyoder@usgs.gov

Process Steps:

• 2016-05-01 00:00:00 - Data for the West Coast El Nino LiDAR project was acquired by Towill. Towill collected approximately 75 square miles of coast in Oregon, 486 square miles of coast in Washington and California, and an additional 44 square miles for USACE defined harbors about 500 meters wide. LiDAR sensor data were collected with the Optech Orion M300 LiDAR system. The data was delivered in the UTM coordinate system, meters, zone 10 and Zone 11, horizontal datum NAD83(2011), vertical datum NAVD88, Geoid 12B. Deliverables for the project included a raw (unclassified) calibrated LiDAR point cloud, survey control, and a final acquisition/calibration report. The calibration process considered all errors inherent with the equipment including errors in GPS, IMU, and sensor specific parameters. Adjustments were made to achieve a flight line to flight line data match (relative calibration) and subsequently adjusted to control for absolute accuracy. Process steps to achieve this are as follows: Rigorous LiDAR calibration: all sources of error such as the sensor's ranging and torsion parameters, atmospheric variables, GPS conditions, and IMU offsets were analyzed and removed to the highest level possible. This method addresses all errors, both vertical and horizontal in nature. Ranging, atmospheric variables, and GPS conditions affect the vertical position of the surface, whereas IMU offsets and torsion parameters affect the data horizontally. The horizontal accuracy is proven through repeatability: when the position of features remains constant no matter what direction the plane was flying and no matter where the feature is positioned within the swath, relative horizontal accuracy is achieved. Absolute horizontal accuracy is achieved through the use of differential GPS with base lines shorter than 25 miles. The base station is set at a temporary monument that is 'tied-in' to the CORS network. The same position is used for every lift, ensuring that any errors in its position will affect all data equally and can therefore be removed equally. Vertical accuracy is achieved through the adjustment to ground control survey points within the finished product. Although the base station has absolute vertical accuracy, adjustments to sensor parameters introduces vertical error that must be normalized in the final (mean) adjustment. Final calibrated swaths were delivered in LAS format 1.4. The withheld and overlap bits are set and all headers, appropriate point data records, and variable length records, including spatial reference information, are updated in GeoCue software and then verified using proprietary Dewberry tools.
• 2014-08-01 00:00:00 - Dewberry utilizes a variety of software suites for inventory management, classification, and data processing. All LiDAR related processes begin by importing the data into the GeoCue task management software. The swath data is tiled according to project specifications (1,500 m x 1,500 m). The tiled data is then opened in Terrascan where Dewberry classifies edge of flight line points that may be geometrically unusable to a separate class. These points are separated from the main point cloud so that they are not used in the ground algorithms. Dewberry then uses proprietary ground classification routines to remove any non-ground points and generate an accurate ground surface. The ground routine consists of three main parameters (building size, iteration angle, and iteration distance); by adjusting these parameters and running several iterations of this routine an initial ground surface is developed. The building size parameter sets a roaming window size. Each tile is loaded with neighboring points from adjacent tiles and the routine classifies the data section by section based on this roaming window size. The second most important parameter is the maximum terrain angle, which sets the highest allowed terrain angle within the model. As part of the ground routine, low noise points are classified to class 7 and high noise points are classified to class 18. Once the ground routine has been completed, bridge decks are classified to class 17 using bridge breaklines compiled by Dewberry. Dewberry classified areas flown outside of low tide to class 64 and temporal ground areas to class 65. A manual quality control routine is then performed using hillshades, cross-sections, and profiles within the Terrasolid software suite. After this QC step, a peer review is performed on all tiles and a supervisor manual inspection is completed on a percentage of the classified tiles based on the project size and variability of the terrain. After the ground classification and bridge deck corrections are completed, the dataset is processed through a water classification routine that utilizes breaklines compiled by Dewberry to automatically classify hydrographic features. The water classification routine selects ground points within the breakline polygons and automatically classifies them as class 9, water. During this water classification routine, points that are within 1x NPS or less of the hydrographic features are moved to class 10, an ignored ground due to breakline proximity. Overage points are then identified in Terrascan and GeoCue is used to set the overlap bit for the overage points and the withheld bit is set on the withheld points previously identified in Terrascan before the ground classification routine was performed. A final QC is performed on the data. The LAS files are then converted from v1.2 to v1.4 using GeoCue software. At this time, all headers, appropriate point data records, and variable length records, including spatial reference information, are updated in GeoCue software and then verified using proprietary Dewberry tools. The data was classified as follows: Class 1 = Unclassified. This class includes vegetation, buildings, noise etc. Class 2 = Ground Class 7= Low Noise Class 9 = Water Class 10 = Ignored Ground due to breakline proximity Class 17 = Bridge Decks Class 18 = High Noise Class 64 = Flown Outside of Low Tide Window Class 65 = Temporal Ground The LAS header information was verified to contain the following: Class (Integer) Adjusted GPS Time (0.0001 seconds) Easting (0.003 m) Northing (0.003 m) Elevation (0.003 m) Echo Number (Integer) Echo (Integer) Intensity (scaled to 16 bit integer) Flight Line (Integer) Scan Angle (degree)
• 2016-05-01 00:00:00 - Dewberry used GeoCue software to produce intensity imagery and raster stereo Models from the source LiDAR. The raster resolution was 0.3 meters.
• 2016-07-01 00:00:00 - LiDAR intensity stereopairs were viewed in 3-D stereo using Socet Set for ArcGIS softcopy photogrammetric software. The breaklines are collected directly into an ArcGIS file geodatabase to ensure correct topology. The LiDARgrammetry was performed under the direct supervision of an ASPRS Certified Photogrammetrist. The breaklines were stereo-compiled in accordance with the Data Dictionary. Tidal breaklines were collected according to specifications for the West Coast El Nino LiDAR Project.
• 2016-07-01 00:00:00 - Dewberry digitzed 2D bridge deck polygons from the intensity imagery and used these polygons to classify bridge deck points in the LAS to class 17. As some bridges are hard to identify in intensity imagery, Dewberry then used ESRI software to generate bare earth elevation rasters. Bare earth elevation rasters do not contain bridges. As bridges are removed from bare earth DEMs but DEMs are continuous surfaces, the area between bridge abutments must be interpolated. The rasters are reviewed to ensure all locations where the interpolation in a DEM indicates a bridge have been collected in the 2D bridge deck polygons.
• 2016-07-01 00:00:00 - Breaklines are reviewed against LiDAR intensity imagery to verify completeness of capture. All breaklines are then compared to ESRI terrains created from ground only points prior to water classification. The horizontal placement of breaklines is compared to terrain features and the breakline elevations are compared to LiDAR elevations to ensure all breaklines match the LiDAR within acceptable tolerances. Some deviation is expected between breakline and LiDAR elevations due to monotonicity and connectivity. Once completeness, horizontal placement, and vertical variance is reviewed, all breaklines are reviewed for topological consistency and data integrity using a combination of ESRI Data Reviewer tools and proprietary tools. Corrections are performed within the QC workflow and re-validated.
• 2016-10-01 00:00:00 - Class 2 ground, Class 9 Water, and Class 10 ignored ground LiDAR points are exported from the LAS files into an Arc Geodatabase (GDB) in multipoint format. An ESRI Terrain is generated from this input and the 3D bridge breaklines. The surface type of the inputs is as follows: Ground Multipoint: Masspoints Bridge Breaklines: Hard Line
• 2016-10-01 00:00:00 - The ESRI Terrain is converted to a raster. The raster is created using linear interpolation with a 0.5 meter cell size. The DEM is reviewed with hillshades in both ArcGIS and Global Mapper. Hillshades allow the analyst to view the DEMs in 3D and to more efficiently locate and identify potential issues. Analysts review the DEM for missed LiDAR classification issues, incorrect breakline elevations, and artifacts that are introduced during the raster creation process.
• 2016-10-01 00:00:00 - The corrected and final DEM is clipped to individual tiles. Dewberry uses a proprietary tool that clips the DEM to each tile located within the final Tile Grid, names the clipped DEM to the Tile Grid Cell name, and verifies that final extents are correct. All individual tiles are loaded into Global Mapper for the last review. During this last review, an analsyt checks to ensure full, complete coverage, no issues along tile boundaries, tiles seamlessly edge-match, and that there are no remaining processing artifacts in the dataset.
• 2017-03-24 00:00:00 - The NOAA Office for Coastal Management (OCM) received 2377 files (UTM10) and 487 files (UTM11) files in IMG format from Dewberry. The DEM files contained elevation measurements in UTM Zones 10 and 11 coordinates in meters with vertical elevations referenced to NAVD88 (Geoid 12b) in meters. OCM ingested the files into the Digital Coast Data Access Viewer. (Citation: DEM tiles)
• 2023-10-02 00:00:00 - The Imagine format files were converted to cloud optimized GeoTiff format to facilitate cloud streaming and compression. The vertical coordinate system (NAVD88 meters) was added to the georeferencing.

This data can be obtained on-line at the following URL: https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=6260;