Program: Civic Analytics
Validating the Use of Wi-Fi Signals
Validating the Use of Wi-Fi Signals to Estimate Hyperlocal Urban Populations
2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA, 2019, pp. 1650-1655
The widespread adoption and use of mobile phone and Wi-Fi enabled devices has created new sources of big data useful for understanding urban mobility and real-time population activity. Wi-Fi networks in particular are being increasingly deployed throughout dense urban areas providing new possibilities to study the dynamics of urban populations. However, there is little known about the ability of Wi-Fi networks to quantify urban populations in real-time, including the accuracy, coverage and capture rate of these networks. In this research, we compare three methods for generating population estimates using Wi-Fi probe request data and validate these approaches with manual count data for a two month period. Despite concerns related to data bias and representativeness, we find that Wi-Fi data can be a viable source of information for estimating urban populations.
The Need for Public Bathrooms
This booklet highlights the importance of public bathrooms in the public realm, especially in improving public health and promoting human rights. We summarize research compiled over the course of a year from our readings, interviews, meetings, and analysis related to public bathrooms. We hope this booklet will serve as a resource for citizens, advocates, architects, urban planners, elected officials, government agencies, local business owners, and others to understand the benefits of public bathrooms, in the hope that we can increase the number of available facilities in our city.
Civic Analytics Fellow Opportunity
Boyeong Hong receives the William H. Whyte Award
Constantine Kontokosta Awarded NSF Grant
NYC Energy & Water Performance Map Highlighted
Topic modeling to discover the thematic structure
Topic modeling to discover the thematic structure and spatial-temporal patterns of building renovation and adaptive reuse in cities
Computers, Environment and Urban Systems
Volume 78, November 2019, 101383
Building alteration and redevelopment play a central role in the revitalization of developed cities, where the scarcity of available land limits the construction of new buildings. The adaptive reuse of existing space reflects the underlying socioeconomic dynamics of the city and can be a leading indicator of economic growth and diversification. However, the collective understanding of building alteration patterns is constrained by significant barriers to data accessibility and analysis. We present a data mining and knowledge discovery process for extracting, analyzing, and integrating building permit data for more than 2,500,000 alteration projects from seven major U.S. cities. We utilize natural language processing and topic modeling to discover the thematic structure of construction activities from permit descriptions and merge with other urban data to explore the dynamics of urban change. The knowledge discovery process proceeds in three steps: (1) text mining to identify popular words, popularity change, and their co-appearance likelihood; (2) topic modeling using latent Dirichlet allocation (LDA); and (3) integrating the topic modeling output with building information and ancillary data to discover the spatial, temporal, and thematic patterns of urban redevelopment and regeneration. The results demonstrate a generalizable approach that can be used to analyze unstructured text data extracted from permit records across varying database structures, permit typologies, and local contexts. Our machine learning methodology can assist cities to better monitor building alteration activity, analyze spatiotemporal patterns of redevelopment, and more fully understand the economic, social, and environmental implications of changes to the urban built environment.