2023 USGS Lidar DEM: San Francisco, CA
Data Set (DS) | OCM Partners (OCMP)GUID: gov.noaa.nmfs.inport:73506 | Updated: September 18, 2024 | Published / External
Summary
Short Citation
OCM Partners, 2024: 2023 USGS Lidar DEM: San Francisco, CA, https://www.fisheries.noaa.gov/inport/item/73506.
Full Citation Examples
Original Dataset Product: These are Digital Elevation Model (DEM) data for California as part of the required deliverables for the CA_SanFrancisco_B23, Work Unit 300449 project. Class 2 (ground) LiDAR points in conjunction with the hydro breaklines were used to create a 0.25 meter hydro-flattened Raster DEM.
Original Dataset Geographic Extent: 4 counties (Alameda, Marin, San Francisco, San Mateo) in California, covering approximately 53 total square miles.
Original Dataset Description: The CA_SanFrancisco_B23, Work Unit 300449 project called for the planning, acquisition, processing, and derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.15 meters. Project specifications are based on the U.S. Geological Survey National Geospatial Program Base LiDAR Specification, 2023 Rev. A. The data were developed based on a horizontal projection/datum of NAD 1983 2011 San Francisco CS13 Meters, Meter and vertical datum of NAVD88 Geoid18, Meter. LiDAR data were delivered as processed Classified LAS 1.4 files formatted to 654 individual 1000 m x 1000 m tiles, as tiled intensity imagery, and as tiled bare earth DEMs; all tiled to the same 1000 m x 1000 m schema. Continuous breaklines were produced in Esri file geodatabase format.
Original Dataset Collection Ground Conditions: LiDAR was collected in spring 2023, while no snow was on the ground and rivers were at or below normal levels. In order to post process the LiDAR data to meet task order specifications and meet ASPRS vertical accuracy guidelines, NV5 Geospatial utilized a total of 13 ground control points that were used to calibrate the LiDAR to known ground locations established throughout the project area. An additional 41 independent accuracy checkpoints, 30 in Bare Earth and Urban landcovers (30 NVA points), 11 in Tall Weeds categories (11 VVA points), were used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data.
This metadata record supports the data entry in the NOAA Digital Coast Data Access Viewer (DAV). For this data set, the DAV is leveraging the USGS GeoTiff files hosted by USGS on Amazon Web Services.
Distribution Information
-
Not Applicable
Create custom data files by choosing data area, map projection, file format, etc. A new metadata will be produced to reflect your request using this record as a base.
-
GeoTIFF
Bulk download of data files in GeoTiff format, San Francisco SC13 NAD83(2011), meters coordinates and elevations in NAVD88 (Geoid18) meters.
None
Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations.
Controlled Theme Keywords
COASTAL ELEVATION, DIGITAL ELEVATION/TERRAIN MODEL (DEM), elevation, TERRAIN ELEVATION
Child Items
No Child Items for this record.
Contact Information
Point of Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov
Metadata Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov
Extents
-122.516107825° W,
-122.326425283° E,
37.8373975022° N,
37.6969866729° S
2023-04-20
Item Identification
Title: | 2023 USGS Lidar DEM: San Francisco, CA |
---|---|
Short Name: | ca2023_sanfran_m10174_metadata |
Status: | Completed |
Creation Date: | 2023 |
Publication Date: | 2024 |
Abstract: |
Original Dataset Product: These are Digital Elevation Model (DEM) data for California as part of the required deliverables for the CA_SanFrancisco_B23, Work Unit 300449 project. Class 2 (ground) LiDAR points in conjunction with the hydro breaklines were used to create a 0.25 meter hydro-flattened Raster DEM. Original Dataset Geographic Extent: 4 counties (Alameda, Marin, San Francisco, San Mateo) in California, covering approximately 53 total square miles. Original Dataset Description: The CA_SanFrancisco_B23, Work Unit 300449 project called for the planning, acquisition, processing, and derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.15 meters. Project specifications are based on the U.S. Geological Survey National Geospatial Program Base LiDAR Specification, 2023 Rev. A. The data were developed based on a horizontal projection/datum of NAD 1983 2011 San Francisco CS13 Meters, Meter and vertical datum of NAVD88 Geoid18, Meter. LiDAR data were delivered as processed Classified LAS 1.4 files formatted to 654 individual 1000 m x 1000 m tiles, as tiled intensity imagery, and as tiled bare earth DEMs; all tiled to the same 1000 m x 1000 m schema. Continuous breaklines were produced in Esri file geodatabase format. Original Dataset Collection Ground Conditions: LiDAR was collected in spring 2023, while no snow was on the ground and rivers were at or below normal levels. In order to post process the LiDAR data to meet task order specifications and meet ASPRS vertical accuracy guidelines, NV5 Geospatial utilized a total of 13 ground control points that were used to calibrate the LiDAR to known ground locations established throughout the project area. An additional 41 independent accuracy checkpoints, 30 in Bare Earth and Urban landcovers (30 NVA points), 11 in Tall Weeds categories (11 VVA points), were used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data. This metadata record supports the data entry in the NOAA Digital Coast Data Access Viewer (DAV). For this data set, the DAV is leveraging the USGS GeoTiff files hosted by USGS on Amazon Web Services. |
Purpose: |
To acquire detailed surface elevation data for use in conservation planning, design, research, floodplain mapping, dam safety assessments and elevation modeling, etc. Classified LAS files are used to show the manually reviewed bare earth surface. This allows the user to create intensity images, breaklines and raster DEMs. The purpose of these LiDAR data was to produce high accuracy 3D hydro-flattened digital elevation models (DEMs) with a 0.25 meter cell size. These raw LiDAR point cloud data were used to create classified LiDAR LAS files, intensity images, 3D breaklines, and hydro-flattened DEMs as necessary. |
Supplemental Information: |
Raster File Type = GeoTIFF; Bit Depth/Pixel Type = 32-bit float; Raster Cell Size = 0.25 meter; Interpolation or Resampling Technique = Triangulated Irregular Network (TIN), Linear Interpolation, Proprietary; Required Vertical Accuracy = 0.196 |
Keywords
Theme Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Science Keywords |
EARTH SCIENCE > LAND SURFACE > TOPOGRAPHY > TERRAIN ELEVATION
|
Global Change Master Directory (GCMD) Science Keywords |
EARTH SCIENCE > LAND SURFACE > TOPOGRAPHY > TERRAIN ELEVATION > DIGITAL ELEVATION/TERRAIN MODEL (DEM)
|
Global Change Master Directory (GCMD) Science Keywords |
EARTH SCIENCE > OCEANS > COASTAL PROCESSES > COASTAL ELEVATION
|
ISO 19115 Topic Category |
elevation
|
Spatial Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Location Keywords |
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA
|
Global Change Master Directory (GCMD) Location Keywords |
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA > CALIFORNIA
|
Global Change Master Directory (GCMD) Location Keywords |
VERTICAL LOCATION > LAND SURFACE
|
Instrument Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Instrument Keywords |
LIDAR > Light Detection and Ranging
|
Platform Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Platform Keywords |
Airplane > Airplane
|
Physical Location
Organization: | Office for Coastal Management |
---|---|
City: | Charleston |
State/Province: | SC |
Data Set Information
Data Set Scope Code: | Data Set |
---|---|
Data Set Type: | Elevation |
Maintenance Frequency: | None Planned |
Data Presentation Form: | Model (digital) |
Distribution Liability: |
Any conclusions drawn from the analysis of this information are not the responsibility of NOAA, the Office for Coastal Management or its partners. |
Data Set Credit: | NV5 Geospatial, USGS |
Support Roles
Data Steward
Date Effective From: | 2024 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Distributor
Date Effective From: | 2024 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Distributor
Date Effective From: | 2024 |
---|---|
Date Effective To: | |
Contact (Organization): | U.S. Geological Survey |
Address: |
12201 Sunrise Valley Drive Reston, VA 20191 USA |
URL: | USGS Home |
Metadata Contact
Date Effective From: | 2024 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Point of Contact
Date Effective From: | 2024 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Extents
Currentness Reference: | Ground Condition |
---|
Extent Group 1
Extent Group 1 / Geographic Area 1
W° Bound: | -122.516107825 | |
---|---|---|
E° Bound: | -122.326425283 | |
N° Bound: | 37.8373975022 | |
S° Bound: | 37.6969866729 |
Extent Group 1 / Time Frame 1
Time Frame Type: | Discrete |
---|---|
Start: | 2023-04-20 |
Spatial Information
Spatial Representation
Representations Used
Grid: | Yes |
---|---|
Vector: | No |
Text / Table: | No |
TIN: | No |
Stereo Model: | No |
Video: | No |
Reference Systems
Reference System 1
Coordinate Reference System |
|||||||||||||||||||||||
|
Reference System 2
Coordinate Reference System |
|||||||||||||||||||||||||||||||||||||
|
Access Information
Security Class: | Unclassified |
---|---|
Data Access Procedure: |
Data is available online for bulk and custom downloads. |
Data Access Constraints: |
None |
Data Use Constraints: |
Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations. |
Distribution Information
Distribution 1
Start Date: | 2024-09-05 |
---|---|
End Date: | Present |
Download URL: | https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=10174/details/10174 |
Distributor: | NOAA Office for Coastal Management (NOAA/OCM) (2024 - Present) |
File Name: | Customized Download |
Description: |
Create custom data files by choosing data area, map projection, file format, etc. A new metadata will be produced to reflect your request using this record as a base. |
Distribution Format: | Not Applicable |
Compression: | Zip |
Distribution 2
Start Date: | 2024 |
---|---|
End Date: | Present |
Download URL: | https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/ |
Distributor: | U.S. Geological Survey (2024 - Present) |
File Name: | Bulk Download |
Description: |
Bulk download of data files in GeoTiff format, San Francisco SC13 NAD83(2011), meters coordinates and elevations in NAVD88 (Geoid18) meters. |
Distribution Format: | GeoTIFF |
URLs
URL 1
URL: | https://coast.noaa.gov/dataviewer/ |
---|---|
Name: | NOAA's Office for Coastal Management (OCM) Data Access Viewer (DAV) |
URL Type: |
Online Resource
|
File Resource Format: | HTML |
Description: |
The Data Access Viewer (DAV) allows a user to search for and download elevation, imagery, and land cover data for the coastal U.S. and its territories. The data, hosted by the NOAA Office for Coastal Management, can be customized and requested for free download through a checkout interface. An email provides a link to the customized data, while the original data set is available through a link within the viewer. |
URL 2
URL: | https://prd-tnm.s3.amazonaws.com/StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/USGS_CA_SanFrancisco_B23_Project_Report.pdf |
---|---|
Name: | USGS Project Report |
URL Type: |
Online Resource
|
File Resource Format: | |
Description: |
Link to the USGS Project Report that provides information about the project, vertical accuracy results, and the point classes and sensors used. |
URL 3
URL: | https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/ |
---|---|
Name: | USGS Additional Info |
URL Type: |
Online Resource
|
Description: |
Link to the reports, breaklines, metadata, and spatial metadata. |
URL 4
URL: | https://prd-tnm.s3.amazonaws.com/StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/reports/CA_SanFrancisco_LiDAR_ProjectReport.pdf |
---|---|
Name: | Lidar Report |
URL Type: |
Online Resource
|
File Resource Format: | |
Description: |
Link to the lidar report. |
Technical Environment
Description: |
MicroStation Connect; TerraScan Version 21.016; STRIPALIGN 2.21 ; TerraModeler Version 21.008; GeoCue Version 2020.1.22.1; Esri ArcGIS 10.6; Global Mapper 19/20; RiProcess 1.8.6; Windows 10 Operating System \\point_cloud\tilecls\*.las |
---|
Data Quality
Horizontal Positional Accuracy: |
Lidar horizontal accuracy is a function of Global Navigation Satellite System (GNSS) derived positional error, f lying altitude, and INS derived attitude error. The obtained RMSEr value is multiplied by a conversion factor of 1.7308 to yield the horizontal component of the National Standards for Spatial Data Accuracy (NSSDA) reporting standard where a theoretical point will fall within the obtained radius 95% of the time. Based on a flying altitude of 1056 meters, an IMU error of 0.002 decimal degrees, and a GNSS positional error of 0.015 meters, this project was compiled to meet 0.12 meter horizontal accuracy at the 95% confidence level or 0.06 cm RMSEr. |
---|---|
Vertical Positional Accuracy: |
This data set was produced to meet ASPRS Positional Accuracy Standard for Digital Geospatial Data (2014) for a 10-cm RMSEz Vertical Accuracy Class. USGS Determined DEM Vertical Accuracy: Tested NVA RMSEz = 1.63 cm Tested 95th percentile value for VVA = 11.05 cm For more information see the USGS project report and the lidar report. The links to these reports are provided in the URL section of this metadata record. |
Completeness Report: |
These LAS data files include all data points collected. No points have been removed or excluded. A visual qualitative assessment was performed to ensure data completeness. No void areas or missing data exist. The raw point cloud is of good quality and the data pass Non-Vegetated Vertical Accuracy specifications. |
Conceptual Consistency: |
Data cover the entire area specified for this project. |
Data Management
Have Resources for Management of these Data Been Identified?: | Yes |
---|---|
Approximate Percentage of Budget for these Data Devoted to Data Management: | Unknown |
Do these Data Comply with the Data Access Directive?: | Yes |
Actual or Planned Long-Term Data Archive Location: | NCEI-NC |
How Will the Data Be Protected from Accidental or Malicious Modification or Deletion Prior to Receipt by the Archive?: |
Data is backed up to cloud storage. |
Lineage
Lineage Statement: |
The NOAA Office for Coastal Management (OCM) ingested references to the USGS GeoTiff files that are hosted on Amazon Web Services (AWS), into the Digital Coast Data Access Viewer (DAV). The DAV accesses the raster data as it resides on AWS under the usgs-lidar-public-container. |
---|
Sources
USGS GeoTiff files
Contact Role Type: | Publisher |
---|---|
Contact Type: | Organization |
Contact Name: | USGS |
Citation URL: | https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/ |
Citation URL Name: | GeoTiff files for CA_SanFrancisco_1 |
Process Steps
Process Step 1
Description: |
Raw Data and Boresight Processing: The boresight for each lift was done individually as the solution may change slightly from lift to lift. The following steps describe the Raw Data Processing and Boresight process: 1) Technicians processed the raw data to LAS format flight lines using the final GPS/IMU solution. This LAS data set was used as source data for boresight. 2) Technicians first used NV5 Geospatial proprietary and commercial software to calculate initial boresight adjustment angles based on sample areas selected in the lift. These areas cover calibration flight lines collected in the lift, cross tie, and production flight lines. These areas are well distributed in the lift coverage and cover multiple terrain types that are necessary for boresight angle calculation. The technicians then analyzed the results and made any necessary additional adjustment until it was acceptable for the selected areas. 3) Once the boresight angle calculation was completed for the selected areas, the adjusted settings were applied to all of the flight lines of the lift and checked for consistency. The technicians utilized commercial and proprietary software packages to analyze how well flight line overlaps matched for the entire lift and adjusted as necessary until the results met the project specifications. 4) Once all lifts were completed with individual boresight adjustment, the technicians checked and corrected the vertical misalignment of all flight lines and also the matching between data and ground truth. The relative accuracy was less than or equal to 7 cm RMSEz within individual swaths and less than or equal to 10 cm RMSEz or within swath overlap (between adjacent swaths). 5) The technicians ran a final vertical accuracy check of the boresighted flight lines against the surveyed checkpoints after the z correction to ensure the requirement of NVA = 19.6 cm 95% Confidence Level (Required Accuracy) was met. |
---|---|
Process Date/Time: | 2024-01-01 00:00:00 |
Process Step 2
Description: |
LAS Point Classification: The point classification is performed as described below. The bare earth surface is then manually reviewed to ensure correct classification on the Class 2 (Ground) points. After the bare-earth surface is finalized, it is then used to generate all hydro-breaklines through heads-up digitization. All ground (ASPRS Class 2) lidar data inside of the Lake Pond and Double Line Drain hydro flattening breaklines were then classified to water (ASPRS Class 9) using TerraScan macro functionality. A buffer of 0.5 feet was also used around each hydro-flattened feature to classify these ground (ASPRS Class 2) points to Ignored ground (ASPRS Class 10). All Lake Pond Island and Double Line Drain Island features were checked to ensure that the ground (ASPRS Class 2) points were reclassified to the correct classification after the automated classification was completed. All overlap data was processed through automated functionality provided by TerraScan to classify the overlapping flight line data to approved classes by USGS. The overlap data was classified using standard LAS overlap bit. These classes were created through automated processes only and were not verified for classification accuracy. Due to software limitations within TerraScan, these classes were used to trip the withheld bit within various software packages. These processes were reviewed and accepted by USGS through numerous conference calls and pilot study areas. All data was manually reviewed and any remaining artifacts removed using functionality provided by TerraScan and TerraModeler. Global Mapper us used as a final check of the bare earth dataset. GeoCue was then used to create the deliverable industry-standard LAS files for both the All Point Cloud Data and the Bare Earth. Proprietary software was used to perform final statistical analysis of the classes in the LAS files, on a per tile level to verify final classification metrics and full LAS header information. |
---|---|
Process Date/Time: | 2024-01-01 00:00:00 |
Process Step 3
Description: |
Maximum Surface Height Rasters were produced as ancillary data from the classified lidar point cloud in order to evaluate the withheld bit flag proof of performance for points that cannot be reasonably interpreted as valid surface returns. These were produced using all returns, withheld flagged points excluded, and using the highest elevation point value from each pixel. These rasters are 32-bit, floating point format and delivered as GeoTIFF files per tile. MSHR are generated from the point cloud data and will not be altered after creation nor will there be further maintenance on this product. |
---|---|
Process Date/Time: | 2024-01-01 00:00:00 |
Process Step 4
Description: |
Swath Separation Imagery was produced for the entire project area. Swath separation images use color-coding to illustrate differences in elevation (z-) values where swaths overlap. The color-coded images are semi-transparent and overlay the lidar intensity image. They are ancillary data used as visual aids to more easily identify regions within point cloud datasets that may have suspect interswath alignment or other geometric issues. Imagery was created using last returns with all classification and bit flags, except for noise and withheld bit flag are included. SSI are generated from the point cloud data and will not be altered after creation nor will there be further maintenance on this product. |
---|---|
Process Date/Time: | 2024-01-01 00:00:00 |
Process Step 5
Description: |
Hydro-Flattened Raster DEM Processing: Class 2 (Ground) LiDAR points in conjunction with the hydro-breaklines were used to create a 0.25 meter hydro-flattened raster DEM. Using automated scripting routines in proprietary software, GeoTIFF files were created for each tile. Each surface was reviewed using Global Mapper to check for any surface anomalies or incorrect elevations found within the surface. |
---|---|
Process Contact: | U.S. Geological Survey |
Process Step 6
Description: |
The NOAA Office for Coastal Management (OCM) created references to the USGS GeoTiff files that were ingested into the NOAA Digital Coast Data Access Viewer (DAV). No changes were made to the data. The DAV will access the raster data as it resides on Amazon Web Services (AWS) under the usgs-lidar-public container. This is the location of the GeoTiffs that are being accessed: https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/ |
---|---|
Process Date/Time: | 2024-09-16 00:00:00 |
Process Contact: | Office for Coastal Management (OCM) |
Related Items
Item Type | Relationship Type | Title |
---|---|---|
Data Set (DS) | Cross Reference |
2023 USGS Lidar: San Francisco, CA |
Catalog Details
Catalog Item ID: | 73506 |
---|---|
GUID: | gov.noaa.nmfs.inport:73506 |
Metadata Record Created By: | Rebecca Mataosky |
Metadata Record Created: | 2024-09-16 14:58+0000 |
Metadata Record Last Modified By: | Rebecca Mataosky |
Metadata Record Last Modified: | 2024-09-18 13:50+0000 |
Metadata Record Published: | 2024-09-16 |
Owner Org: | OCMP |
Metadata Publication Status: | Published Externally |
Do Not Publish?: | N |
Metadata Last Review Date: | 2024-09-05 |
Metadata Review Frequency: | 1 Year |
Metadata Next Review Date: | 2025-09-05 |