| 2004 USGS Lidar: San Francisco Bay (CA) | spatialRepresentationInfo|
|---|---|
| (MI_Metadata) fileIdentifier: gov.noaa.nmfs.inport:49635 language: LanguageCode: eng characterSet: (MD_CharacterSetCode) UTF8 hierarchyLevel: (MD_ScopeCode) dataset contact: (CI_ResponsibleParty) organisationName: OCM Partners contactInfo: (CI_Contact) phone: (CI_Telephone) voice: (missing) address: (CI_Address) role: (CI_RoleCode) resourceProvider contact: (CI_ResponsibleParty) organisationName: NOAA Office for Coastal Management contactInfo: (CI_Contact) phone: (CI_Telephone) voice: (843) 740-1202 address: (CI_Address) deliveryPoint: 2234 South Hobson Ave city: Charleston administrativeArea: SC postalCode: 29405-2413 country: (missing) electronicMailAddress: coastal.info@noaa.gov onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov protocol: WWW:LINK-1.0-http--link name: NOAA Office for Coastal Management Website description: NOAA Office for Coastal Management Home Page function: (CI_OnLineFunctionCode) information role: (CI_RoleCode) pointOfContact dateStamp: DateTime: 2022-08-09T17:11:37 metadataStandardName: ISO 19115-2 Geographic Information - Metadata Part 2 Extensions for imagery and gridded data metadataStandardVersion: ISO 19115-2:2009(E) return to top spatialRepresentationInfo: return to top referenceSystemInfo: return to top referenceSystemInfo: (MD_ReferenceSystem) referenceSystemIdentifier: (RS_Identifier) authority: (CI_Citation) title: NAD83(HARN) date: (CI_Date) date: 2008-11-12 dateType: (CI_DateTypeCode) publication citedResponsibleParty: (CI_ResponsibleParty) organisationName: European Petroleum Survey Group contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://apps.epsg.org/api/v1/CoordRefSystem/4152/export/?format=gml role: (missing) code: urn:ogc:def:crs:EPSG:4152 version: 6.18.3 return to top referenceSystemInfo: (MD_ReferenceSystem) referenceSystemIdentifier: (RS_Identifier) authority: (CI_Citation) title: North American Vertical Datum of 1988 (NAVD88) (GEOID18) meters alternateTitle: North American Vertical Datum of 1988 (NAVD88) (GEOID18) meters citedResponsibleParty: (CI_ResponsibleParty) organisationName: (withheld) contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://apps.epsg.org/api/v1/VerticalCoordRefSystem/5703/?api_key=gml name: North American Vertical Datum of 1988 (NAVD88) (GEOID18) meters description: Link to Geographic Markup Language (GML) description of reference system. function: (CI_OnLineFunctionCode) information role: (CI_RoleCode) resourceProvider citedResponsibleParty: (CI_ResponsibleParty) organisationName: European Petroleum Survey Group contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://www.epsg.org/ name: European Petroleum Survey Group Geodetic Parameter Registry description: Registry that accesses the EPSG Geodetic Parameter Dataset, which is a structured dataset of Coordinate Reference Systems and Coordinate Transformations. function: (CI_OnLineFunctionCode) search role: (CI_RoleCode) publisher VerticalCS: metaDataProperty: CommonMetaData: type: vertical informationSource: OGP revisionDate: 2006-11-28 isDeprecated: false identifier: urn:ogc:def:cs:EPSG::6499 name: Vertical CS. Axis: height (H). Orientation: up. UoM: meter. remarks: Used in vertical coordinate reference systems. axis: CoordinateSystemAxis: descriptionReference: urn:ogc:def:axis-name:EPSG::9904 identifier: urn:ogc:def:axis:EPSG::114 axisAbbrev: H axisDirection: up code: urn:ogc:def:crs:EPSG::5703 return to top identificationInfo: (MD_DataIdentification) citation: (CI_Citation) title: 2004 USGS Lidar: San Francisco Bay (CA) alternateTitle: ca2004_usgs_sanfranbay_m5009_metadata date: (CI_Date) date: 2016-03-11 dateType: (CI_DateTypeCode) publication identifier: (MD_Identifier) authority: (CI_Citation) title: NOAA/NMFS/EDM date: (inapplicable) code: Anchor: InPort Catalog ID 49635 citedResponsibleParty: (CI_ResponsibleParty) organisationName: (inapplicable) contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://www.fisheries.noaa.gov/inport/item/49635 protocol: WWW:LINK-1.0-http--link name: Full Metadata Record description: View the complete metadata record on InPort for more information about this dataset. function: (CI_OnLineFunctionCode) information role: (inapplicable) citedResponsibleParty: (CI_ResponsibleParty) organisationName: (inapplicable) contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov/dataviewer protocol: WWW:LINK-1.0-http--link name: Citation URL description: Online Resource function: (CI_OnLineFunctionCode) download role: (inapplicable) citedResponsibleParty: (CI_ResponsibleParty) organisationName: (inapplicable) contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov protocol: WWW:LINK-1.0-http--link name: Citation URL description: Online Resource function: (CI_OnLineFunctionCode) download role: (inapplicable) abstract: Lidar (Light detection and ranging) discrete-return point cloud data are available in the American Society for Photogrammetry and Remote Sensing (ASPRS) LAS format. The LAS format is a standardized binary format for storing 3-dimensional point cloud data and point attributes along with header information and variable length records specific to the data. Millions of data points are stored as a 3-dimensional data cloud as a series of x (longitude), y (latitude) and z (elevation) points. This data set is an LAZ (compressed LAS) format file containing LIDAR point cloud data. purpose: High-resolution digital elevation maps generated by airborne and stationary LiDAR have led to significant advances in geomorphology, the branch of geoscience concerned with the origin and evolution of Earth's surface topography. LiDAR provides unique characteristics relative to other remotely sensed data sources by providing three-dimensional feature information that cannot be derived from traditional imaging sensors. status: (MD_ProgressCode) completed pointOfContact: (CI_ResponsibleParty) organisationName: NOAA Office for Coastal Management contactInfo: (CI_Contact) phone: (CI_Telephone) voice: (843) 740-1202 address: (CI_Address) deliveryPoint: 2234 South Hobson Ave city: Charleston administrativeArea: SC postalCode: 29405-2413 country: (missing) electronicMailAddress: coastal.info@noaa.gov onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov protocol: WWW:LINK-1.0-http--link name: NOAA Office for Coastal Management Website description: NOAA Office for Coastal Management Home Page function: (CI_OnLineFunctionCode) information role: (CI_RoleCode) pointOfContact pointOfContact: (CI_ResponsibleParty) organisationName: NOAA Office for Coastal Management contactInfo: (CI_Contact) phone: (CI_Telephone) voice: (843) 740-1202 address: (CI_Address) deliveryPoint: 2234 South Hobson Ave city: Charleston administrativeArea: SC postalCode: 29405-2413 country: (missing) electronicMailAddress: coastal.info@noaa.gov onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov protocol: WWW:LINK-1.0-http--link name: NOAA Office for Coastal Management Website description: NOAA Office for Coastal Management Home Page function: (CI_OnLineFunctionCode) information role: (CI_RoleCode) custodian resourceMaintenance: (MD_MaintenanceInformation) maintenanceAndUpdateFrequency: (MD_MaintenanceFrequencyCode) asNeeded graphicOverview: (MD_BrowseGraphic) fileName: https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid18/5009/supplemental/ca2004_usgs_sanfranbay_m5009.kmz fileDescription: This graphic shows the lidar coverage for the 2004 USGS project along the southern area of San Francisco Bay. fileType: kmz descriptiveKeywords: (MD_Keywords) keyword: Lidar - partner (no harvest) type: (MD_KeywordTypeCode) project thesaurusName: (CI_Citation) title: InPort date: (inapplicable) resourceConstraints: (MD_LegalConstraints) useConstraints: (MD_RestrictionCode) otherRestrictions otherConstraints: Cite As: OCM Partners, [Date of Access]: 2004 USGS Lidar: San Francisco Bay (CA) [Data Date Range], https://www.fisheries.noaa.gov/inport/item/49635. resourceConstraints: (MD_Constraints) useLimitation: NOAA provides no warranty, nor accepts any liability occurring from any incomplete, incorrect, or misleading data, or from any incorrect, incomplete, or misleading use of the data. It is the responsibility of the user to determine whether or not the data is suitable for the intended purpose. resourceConstraints: (MD_LegalConstraints) accessConstraints: (MD_RestrictionCode) otherRestrictions useConstraints: (MD_RestrictionCode) otherRestrictions otherConstraints: Access Constraints: None | Use Constraints: Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations. These data depict the heights at the time of the survey and are only accurate for that time. | Distribution Liability: Any conclusions drawn from the analysis of this information are not the responsibility of SFSU, USGS, NOAA, the Office for Coastal Management or its partners. resourceConstraints: (MD_SecurityConstraints) classification: (MD_ClassificationCode) unclassified classificationSystem: (missing) handlingDescription: (missing) aggregationInfo: (MD_AggregateInformation) aggregateDataSetName: (CI_Citation) title: NOAA Data Management Plan (DMP) date: (unknown) identifier: (MD_Identifier) authority: (CI_Citation) title: NOAA/NMFS/EDM date: (inapplicable) code: 49635 citedResponsibleParty: (CI_ResponsibleParty) organisationName: (inapplicable) contactInfo: (CI_Contact) onlineResource: (CI_OnlineResource) linkage: https://www.fisheries.noaa.gov/inportserve/waf/noaa/nos/ocmp/dmp/pdf/49635.pdf protocol: WWW:LINK-1.0-http--link name: NOAA Data Management Plan (DMP) description: NOAA Data Management Plan for this record on InPort. function: (CI_OnLineFunctionCode) information role: (inapplicable) associationType: (DS_AssociationTypeCode) crossReference spatialRepresentationType: (MD_SpatialRepresentationTypeCode) vector language: eng; US topicCategory: (MD_TopicCategoryCode) elevation extent: (EX_Extent) geographicElement: (EX_GeographicBoundingBox) westBoundLongitude: -122.1251999 eastBoundLongitude: -122.0622972 southBoundLatitude: 37.4205777 northBoundLatitude: 37.437986 temporalElement: (EX_TemporalExtent) extent: TimePeriod: description: | Currentness: Ground Condition beginPosition: 2004-05-05 endPosition: 2004-05-21 supplementalInformation: A report for this project is available at: https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid18/5009/supplemental/ca2004_usgs_sanfranbay_m5009_lidarreport.pdf A footprint of this data set may be viewed in Google Earth at: https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid18/5009/supplemental/ca2004_usgs_sanfranbay_m5009.kmz return to top contentInfo: (MD_FeatureCatalogueDescription) complianceCode: false language: LanguageCode: eng includedWithDataset: false featureCatalogueCitation: (CI_Citation) title: none date: (unavailable) return to top distributionInfo: (MD_Distribution) distributor: (MD_Distributor) distributorContact: (CI_ResponsibleParty) organisationName: NOAA Office for Coastal Management contactInfo: (CI_Contact) phone: (CI_Telephone) voice: (843) 740-1202 address: (CI_Address) deliveryPoint: 2234 South Hobson Ave city: Charleston administrativeArea: SC postalCode: 29405-2413 country: (missing) electronicMailAddress: coastal.info@noaa.gov onlineResource: (CI_OnlineResource) linkage: https://coast.noaa.gov protocol: WWW:LINK-1.0-http--link name: NOAA Office for Coastal Management Website description: NOAA Office for Coastal Management Home Page function: (CI_OnLineFunctionCode) information role: (CI_RoleCode) distributor transferOptions: (MD_DigitalTransferOptions) onLine: (CI_OnlineResource) linkage: https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=5009 protocol: WWW:LINK-1.0-http--link name: Customized Download description: Create custom data files by choosing data area, product type, map projection, file format, datum, etc. function: (CI_OnLineFunctionCode) download transferOptions: (MD_DigitalTransferOptions) onLine: (CI_OnlineResource) linkage: https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid18/5009/index.html protocol: WWW:LINK-1.0-http--link name: Bulk Download description: Simple download of data files. function: (CI_OnLineFunctionCode) download return to top dataQualityInfo: (DQ_DataQuality) scope: (DQ_Scope) level: (MD_ScopeCode) dataset report: (DQ_QuantitativeAttributeAccuracy) nameOfMeasure: Accuracy evaluationMethodDescription: Data are provided in las format version las 1.0. Header attributes and point attribute for LAS files can be found on ASPRS website listed below. USGS not making any promises on the accuracy or completeness of the attribute information. result: (missing) report: (DQ_AbsoluteExternalPositionalAccuracy) nameOfMeasure: Horizontal Positional Accuracy evaluationMethodDescription: Accuracy is as follows, quoted at the 95% confidence level (2 sigma); Quantitative Value: 0.40 meters, Test that produced the value: +/- 20-60 cm on all but extremely hilly terrain result: (missing) report: (DQ_AbsoluteExternalPositionalAccuracy) nameOfMeasure: Vertical Positional Accuracy evaluationMethodDescription: Accuracy is as follows, quoted at the 95% confidence level (2 sigma); Quantitative Value: 0.0647 meters, Test that produced the value: RMSE (1 sigma) calculated to be 6.47 cm. 593 kinematic check points compared to the LiDAR bald earth surface on paved surfaces found that the average error was -1.9 centimeters and that 95% (2 sigma) of the checkpoints were within 13.2 centimeters of true values. result: (missing) report: (DQ_CompletenessCommission) nameOfMeasure: Completeness Report evaluationMethodDescription: The lidar collection has been acquired by the USGS through contracts, partnerships with other Federal, state, tribal, or regional agencies, from direct purchases from private industry vendors, and through volunteer contributions from the science community. While USGS makes every effort to provide accurate and complete information, USGS provides no warranty, expressed or implied, as to the accuracy, reliability or completeness of furnished lidar point clouds. Please note that USGS does not control and cannot guarantee the relevance, timeliness, or accuracy of these outside materials. result: (missing) report: (DQ_ConceptualConsistency) nameOfMeasure: Conceptual Consistency evaluationMethodDescription: Please refer to the Metadata Section at the end of this document for a live link to a copy of the original data source's metadata file if one was provided. result: (missing) lineage: (LI_Lineage) statement: (missing) processStep: (LI_ProcessStep) description: The points are generated as Terrascan binary Format using Terrapoint's proprietary Laser Postprocessor Software. This software combines the Raw Laser file and GPS/IMU information to generate a point cloud for each individual flight. All the point cloud files encompassing the project area were then divided into 2 kilometer by 2-kilometer tiles. The referencing system of these tiles is based upon the project boundary minimum and maximums. This process is carried out in Terrascan. The bald earth is subsequently extracted from the raw LiDAR points using Terrascan in a Microstation environment. The automated vegetation removal process takes place by building an iterative surface model. This surface model is generated using three main parameters: Building size, Iteration angle and Iteration distance. The initial model is based upon low points selected by a roaming window and are assumed to be ground points. The size of this roaming window is determined by the building size parameter. These low points are triangulated and the remaining points are evaluated and subsequently added to the model if they meet the Iteration angle and distance constraints (fig. 1). This process is repeated until no additional points are added within an iteration. There is also a maximum terrain angle constraint that determines the maximum terrain angle allowed within the model. Quality Control Once the data setup has taken place the manual quality control of the surface occurs. This process consists of visually examining the LiDAR points within Terrascan and correcting errors that occurred during the automated process. These corrections include verifying that all non ground elements, such as vegetation and buildings are removed from the ground model and that all small terrain undulations such as road beds, dykes, rock cuts and hill tops are present within the model. This process is done with the help of hillshades, contours, profiles and crosssections. To correct misclassifications, a full suite of Terrascan and custom in-house data tools are used. Deliverables All LiDAR Data Products were delivered on DVD-ROM. Three copies were provided. All products other than hill-shade data were provided in 1k and 2k tiles with a 25-meter buffer. Hill-shades were delivered in three large areas. Full Feature or All Return Point Data Data delivered in ASCII, comma delimited files with one record per return as defined in Table 4. The records are ordered sequentially according to Easting with no duplicate records. The individual returns are classified into the categories as defined in Table 5. If a return cannot be reliably classified as "Vegetation" or "Building/structure", it shall be assigned as "Not ground". This product was generated using an in house custom utility. The process involved extracting a Terrascan Binary file packed with the scan angle and the extra precision required for the for a unique time stamp. - Bare Earth Point Data Data delivered in ASCII, fixed length, formatted files with one record per return as defined in Table 4 in the attached report. The records are ordered sequentially according to Easting with no duplicate records. The individual returns are classified according to the categories defined. This product was generated using an in house custom utility. The process involved extracting a Terrascan Binary file packed with the scan angle and the extra precision required for the for a unique time stamp. Bare Earth and Full Feature Hill-Shade Image Data delivered in GeoTIFF format with a TFW file. The image resolution is 1m. This product was generated in ArcView. dateTime: DateTime: 2005-01-28T00:00:00 processStep: (LI_ProcessStep) description: Contour Data Data is delivered at 50cm nominal contour interval, 2.5m labeled index contours in AutoCAD format. This product was generated using a combination of TerraModeler and Microstation. Data Field 1: Time GPS time Reported to nearest microsecond Data Field 2: x,y location Geographic location of return NAD83-92, to nearest 0.01m Data Field 3: Elevation Elevation of return NAVD-88, to nearest 0.01m Data Field 4: Return classification Return classification of this return First or last return Data Field 5: Off Nadir Angle Angle between nadir and transmitted pulse Reported to nearest 0.01 degrees Data Field 6: Return Intensity Intensity of return Data Field 7: Classification Code Classification of Return Please note that all products, other than the hillshade products were delivered in 2 kilometer tiles and 1 kilometer tiles. Return Classification System Code Description Notes 2 Ground or water -Bare Earth surface 5 Vegetation -Non-ground points, 1.51 m up to 60 m above coincident ground dateTime: DateTime: 2005-01-28T00:00:00 processStep: (LI_ProcessStep) description: Problems, Resolutions and Conclusions Boresight Our laser encountered some technical difficulties during acquisition. The laser manufacturer, Riegl, was unable to pin point the problem on the bench due to the small magnitude of the error. Riegl anticipated this result due to the limits of testing within a lab setting. As a precaution to eliminate any possible source of error, the laser angle encoder unit and the bearings were replaced. As an additional precaution, an extra screw was added during the inspection to improve the mounting of encoder mechanism. The unit belt was eliminated as the source of the problem. As a result of this malfunction, the boresight values for each flight had to be thoroughly reviewed. This manual process took approximately three weeks to resolve for the appropriate boresight corrections. The majority of the flights required a single roll correction of 0.097 degrees while others required an adjustment of 0.068 or 0.142 degrees. Certain flights required two-roll corrections. Unfortunately, this boresight problem caused by equipment malfunction was only discovered after initially delivering the project - this was principally due to a shortcoming in our QC methodology that did not reveal mechanical problems such as those encountered with our scanning laser. It should be noted that the laser deployed for this project had previously operated without error on approximately 200 missions. We therefore consider the problems encountered with the South Bay project to be an outlier. Nevertheless, our processing flow has now been modified to identify such outliers by performing more quality control checks on the data prior to entering production. These include: profiles, full feature hillshades, GPS checks and distance grids. The distance grids are quite beneficial as they visually display relative elevation error between flightlines. Please note that we attempted to perform distance grids on all the tiles, but were successful on only 127 of 145 tiles due to lack of overlap in open water or tiles containing a great deal of flightlines causing the application to crash. Close attention was paid to these tiles in particular during the second round of production as to ensure the quality was good. dateTime: DateTime: 2005-01-28T00:00:00 processStep: (LI_ProcessStep) description: The distance images were captured as screengrabs from the application and are located on the accompanying disk. The late discovery of this problem proved to be special challenge, as the processing team had spent the majority of the initial filtering run extracting the buildings from the point cloud. To deliver this project in a rapid manner, we opted to maintain the building classifications as to minimize the amount of reprocessing. Therefore we could not reprocess the point cloud with the boresight compensation values. An additional problem ensued; two GPS week rollovers occurred during acquisition. Due to software limitations we are unable to store GPS week, only GPS time, therefore, there is a strong likelihood of having multiple identical GPS times within the dataset. This situation leads to the possibility of associating the LiDAR data to the wrong trajectory and applying an incorrect roll compensation factor based upon aircraft position and required correction. To overcome these obstacles we developed a new procedure using existing software and custom applications. Once applied, these corrections were verified with the aforementioned distance grids. This issue is being addressed in future projects by allowing the LiDAR operator to tag flight lines with an attribute during acquisition. As a result of applying the roll compensation the overall quality of the dataset increased significantly allowing the project to meet the set accuracy guidelines. Upon the discovery of this problem by the USGS a few selected distance grids were generated. These grids indicated an average error of 30 centimeters while a few areas indicated errors of 45-50 centimeters. Once the boresight corrections were applied, all but a few areas are now within the range of +/- 15 centimeters. A few areas remain as outliers in the 15 to 30 cm range. A benefit of the correction was the elimination of "false vegetation". The error was more evident in flat open areas of the mud flats. The error manifested itself to look like isolated areas of low scrub. Once corrected these were reduced significantly to meet specification or eliminated all together. Vegetation removal also proved to be tricky as quite often the bulrush directly adjoining dikes masked themselves as extensions to the dikes. Pickle weed and other forms of low vegetation shorter than 20 cm also tended blend very well into the mudflats. Particular attention had to be paid to these areas and the assistance of the USGS proved to be a valuable asset in discerning valid ground from vegetation. dateTime: DateTime: 2005-01-28T00:00:00 processStep: (LI_ProcessStep) description: The NOAA Office for Coastal Management (OCM) received the files in laz format from USGS via an FTP online repository. The files contained lidar elevation and intensity measurements. The data were in State Plane California Zone 3 and Zone 4, NAVD88 (orthometric) heights in meters. The California Coastal Project was divided into two projects: State Plane Zone 3 and State Plane Zone 4 respectively. OCM performed the following processing for data storage and Digital Coast provisioning purposes: 1. The data were converted from state plane coordinates to geographic coordinates. 2. The data were converted from NAVD88 (orthometric) heights in meters to GRS80 (ellipsoid) heights in meters using Geoid 09. 3. The LAS Noise class was dropped and Class 4 (medium vegetation scrutinized). All Class 4 points are considered to include all vegetation and man made objects. dateTime: DateTime: 2016-02-10T00:00:00 processStep: (LI_ProcessStep) description: The vertical values in this data set have been converted to reference North American Vertical Datum of 1988 (NAVD88) (GEOID18) meters, using the GEOID18 grids provided by the National Geodetic Survey. Any datum and projection transformations were then done with the Office for Coastal Management 'datum_shift' program. Compression to an LAZ file was done with the LAStools 'laszip' program and can be unzipped with the same free program (laszip.org) Processing notes: dateTime: DateTime: 2023-07-01T07:29:24 processor: (CI_ResponsibleParty) individualName: NOAA Office for Coastal Management contactInfo: (CI_Contact) address: (CI_Address) electronicMailAddress: coastal.info@noaa.gov role: (CI_RoleCode) processor | |