Geology Reports⌕ Search

USGS · 70194256

An evaluation of sampling and full enumeration strategies for Fisher Jenks classification in big data settings

Abstract

Large data contexts present a number of challenges to optimal choropleth map classifiers. Application of optimal classifiers to a sample of the attribute space is one proposed solution. The properties of alternative sampling-based classification methods are examined through a series of Monte Carlo simulations. The impacts of spatial autocorrelation, number of desired classes, and form of sampling are shown to have significant impacts on the accuracy of map classifications. Tradeoffs between improved speed of the sampling approaches and loss of accuracy are also considered. The results suggest the possibility of guiding the choice of classification scheme as a function of the properties of large data sets.

Explore related subjects

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Sergio J. Rey, Philip A. Stephens, Jason R. Laura. 2016-10-04. An evaluation of sampling and full enumeration strategies for Fisher Jenks classification in big data settings. https://doi.org/10.1111/tgis.12236

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related USGS reports

Structure-aware unsupervised transmission corridor structure extraction from 3DEP lidar using graph attention embeddings and reinforcement-learned DBSCAN

Transmission corridors are critical components of power delivery infrastructure, and their large-area monitoring increasingly relies on national-scale airborne lidar programs. This study presents an unsupervised, scalable framework for extracting transmission corridor structures (including conductors and supporting towers) from U.S. Geological Survey (USGS) 3D Elevation Program (3DEP) lidar point clouds. The workflow begins with height-above-ground filtering and statistical outlier removal to isolate elevated infrastructure candidates. Local Principal Component Analysis (PCA) is then used to compute fine-scale geometric descriptors. To incorporate spatial context and improve structural separability in feature space, we learn point embeddings using a Graph Attention Network (GAT) trained with a structure-consistency triplet objective, yielding representations tailored for downstream density-based grouping rather than semantic classification. To address the spatial non-stationarity of point density and noise across large scenes, we formulate Density-Based Spatial Clustering of Applications with Noise (DBSCAN) parameter selection as a reinforcement learning problem and employ Proximal Policy Optimization (PPO) to adapt 𝜀 and minPts at the block level based on embedding statistics. The final extraction is produced via block-wise DBSCAN and spatial merging to support efficient processing of multi-million-point clouds. Experiments on USGS 3DEP data over Houston, Texas, show that the proposed method produces spatially coherent candidate corridor structures from unstructured lidar. Quantitative assessment is conducted using OpenStreetMap (OSM)-referenced spatial-agreement metrics under a consistent vector-reference protocol, alongside comparative baselines and ablation studies, to examine the relative contributions of graph embedding learning and RL-based adaptive clustering.

Texas↗

GeoAI in the US Geological Survey for topographic mapping

Geospatial artificial intelligence (GeoAI) can be defined broadly as the application of artificial intelligence methods and techniques to geospatial data, processes, models, and applications. The application of these methods to topographic data and phenomena is a focus of research in the US Geological Survey (USGS). Specifically, the USGS has researched and developed applications in terrain feature extraction, hydrographic network extraction, and semantic modeling. This article is a documentation of the recent work and current state of research and development. The article helps define the accomplishments and directions of research and applications in fields of GeoAI for topographic mapping within the USGS and more broadly.

Transactions in GIS↗

GeoNat v1.0: A dataset for natural feature mapping with artificial intelligence and supervised learning

Machine learning allows “the machine” to deduce the complex and sometimes unrecognized rules governing spatial systems, particularly topographic mapping, by exposing it to the end product. Often, the obstacle to this approach is the acquisition of many good and labeled training examples of the desired result. Such is the case with most types of natural features. To address such limitations, this research introduces GeoNat v1.0, a natural feature dataset, used to support artificial intelligence‐based mapping and automated detection of natural features under a supervised learning paradigm. The dataset was created by randomly selecting points from the U.S. Geological Survey’s Geographic Names Information System and includes approximately 200 examples each of 10 classes of natural features. Resulting data were tested in an object‐detection problem using a region‐based convolutional neural network. The object‐detection tests resulted in a 62% mean average precision as baseline results. Major challenges in developing training data in the geospatial domain, such as scale and geographical representativeness, are addressed in this article. We hope that the resulting dataset will be useful for a variety of applications and shed light on training data collection and labeling in the geospatial artificial intelligence domain.

Transactions in GIS↗