README / README.md
SimonProvost's picture
core: add CSAI Data Gathering
c2a36d1 verified
|
raw
history blame
13.1 kB
---
title: README
emoji: 🌍
colorFrom: blue
colorTo: green
sdk: static
pinned: true
license: mit
---
<style>
.grid {
display: grid;
}
.lg\:grid-cols-2 {
grid-template-columns: repeat(2, 1fr);
}
.lg\:grid-cols-3 {
grid-template-columns: repeat(3, 1fr);
}
.gap-4 {
gap: 1rem;
}
.alert {
padding: 1rem;
border-radius: 0.5rem;
margin: 1rem 0;
}
.alert-info {
background-color: #e7f3fe;
border: 1px solid #b3d4fc;
}
.alert-important {
background-color: #fff3e0;
border: 1px solid #ffcc80;
}
.feature-icon {
width: 1.5em;
height: 1.5em;
vertical-align: middle;
margin-right: 0.5rem;
}
.centered {
display: flex;
justify-content: center;
align-items: center;
height: 100%;
}
.quotes-title {
text-align: center;
color: #666;
font-size: 0.9em;
font-weight: bold;
font-family: Georgia,Times,Times New Roman,serif;
}
.quote-column {
display: flex;
flex-direction: column;
justify-content: center;
}
.feature-icon {
width: 1.5em;
height: 1.5em;
vertical-align: middle;
margin-right: 0.5rem;
}
.title-icon {
margin-top: -3rem;
}
</style>
<div class="grid lg:grid-cols-2 gap-4">
<div class="col-span-1 centered">
<img src="https://huggingface.co/spaces/oscur/README/resolve/main/OSCUR_vision.png" alt="OSCUR Logo" style="max-height: 250px; width: auto;">
</div>
<div class="col-span-1 centered">
<div style="margin-top: 50px">
<h1>OSCUR: Open-Source Cyberinfrastructure for Urban Computing</h1>
<p><strong>OSCUR</strong> is transforming urban computing by making complex city data accessible and actionable through open-source tools. Funded by a $5M National Science Foundation grant, we empower researchers, city planners, and communities to tackle urban challenges like transportation, climate change, and environmental justice.</p>
</div>
</div>
</div>
<h1><span><img src="https://www.svgrepo.com/show/384267/360-vision-picture-image.svg" class="feature-icon" style="display: inline; vertical-align: middle; justify-content: center"> Vision</span></h1>
<div class="grid lg:grid-cols-2 gap-4 title-icon">
<div class="col-span-1">
<h3>We Aim to Revolutionize Urban Computing</h3>
<ul>
<li><strong>Foster Partnerships</strong>: Advance open and reproducible urban analytics through collaboration.</li>
<li><strong>Leverage NSF Initiatives</strong>: Harness the strengths of existing NSF-funded projects.</li>
<li><strong>Promote Civic & Global Programs</strong>: Support civic initiatives, research, and education worldwide.</li>
<li><strong>Democratize Urban Computing</strong>: Make analytics accessible to all globally.</li>
</ul>
</div>
<div class="col-span-1">
<h3>Outcomes</h3>
<ul>
<li>A novel open-source cyberinfrastructure for reproducible urban computing.</li>
<li>A cohesive and engaged urban computing community.</li>
<li>A path toward healthier, more resilient, accessible, and sustainable cities.</li>
</ul>
</div>
</div>
<div style="margin-top: -50px">
<h3><img src="https://www.svgrepo.com/show/488665/quote-left.svg" class="feature-icon col-span-2 quotes-title" style="display: inline; vertical-align: middle;"> They Say It Best...</h3>
<div class="grid lg:grid-cols-2 gap-4" style="margin-top: -3em;">
<div class="col-span-1 quote-column">
<blockquote>
"While open data is increasingly available across a host of urban areas - from resource consumption to housing and infrastructure — its potential remains largely untapped because of unique challenges related to the diversity and scale of the data and the complex computations required to obtain trustworthy insights. OSCUR intends to unlock that potential"
<footer>— <a href="https://engineering.nyu.edu/faculty/claudio-silva" target="_blank">Claudio Silva</a>, NYU Tandon School of Engineering</footer>
</blockquote>
</div>
<div class="col-span-1 quote-column">
<blockquote>
"With OSCUR, we're trying to democratize urban computing and empower a broad range of stakeholders to analyze urban data at scale. We want to remove the silos in which urban data typically lives, lower the barrier to entry for urban computing and facilitate better collaboration. By providing a unified platform with powerful tools, we hope to accelerate research and development in this critical field."
<footer>— <a href="https://engineering.nyu.edu/faculty/juliana-freire" target="_blank">Juliana Freire</a>, NYU Tandon School of Engineering</footer>
</blockquote>
</div>
</div>
<details>
<summary>Show more quotes</summary>
<div class="grid lg:grid-cols-2 gap-4" style="margin-top: 0.1em;">
<div class="col-span-1 quote-column">
<blockquote>
"OSCUR empowers us to turn data into action for healthier cities. One of the key aspects is lowering the barriers to accessing this wealth of technologies we have been building over the past years. We’re creating analyses and visualizations that ensure that community members are aware of how they are impacted."
<footer>— <a href="https://cs.uic.edu/profiles/miranda-fabio/" target="_blank">Fabio Miranda</a>, University of Illinois Chicago</footer>
</blockquote>
<blockquote>
"Many cities and governments and industries are putting data out there, but it’s just very hard to use. Imagine if you hire the best chef in the world and give them the best ingredients, but you don’t give them any tools. No matter how good the chef is, if they don’t have the proper tools, they can’t make a good dish."
<footer>— <a href="https://cme.uic.edu/profiles/sybilderrible/" target="_blank">Sybil Derrible</a>, University of Illinois Chicago</footer>
</blockquote>
</div>
<div class="col-span-1 quote-column">
<blockquote>
"The true beauty and promise of OSCUR is in how it attempts to unify long-standing and deeply interconnected problems in urban science that often have disparate approaches spread across disciplines."
<footer>— <a href="https://www.cs.washington.edu/people/faculty/jon-e-froehlich/" target="_blank">Jon E. Froehlich</a>, University of Washington</footer>
</blockquote>
<blockquote>
"Because of their history, relationships between government and marginalized communities can be fraught with distrust — including distrust towards the data that government releases. You need to put time and effort into building something that is trustworthy and valuable for the community, in terms of allowing them to analyze the data in a way that matters to them."
<footer>— <a href="https://fusifederica.weebly.com/" target="_blank">Federica Fusi</a>, University of Illinois Chicago</footer>
</blockquote>
</div>
</details>
</div>
</div>
<div style="margin-top: 2em; font-size: 0.9em;">
<p>
<strong>Sources:</strong>
<a href="https://engineering.nyu.edu/news/urban-computing-get-boost-new-open-source-platform-funded-national-science-foundation" target="_blank">Urban computing gets a boost — NYU Tandon</a> |
<a href="https://today.uic.edu/uic-researchers-join-national-project-to-turn-urban-data-into-healthier-cities/" target="_blank">UIC researchers join national project — UIC Today</a>
</p>
</div>
<h1><span><img src="https://www.svgrepo.com/show/470665/objects-on-phone.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Key Features</span></h1>
<div class="title-icon" style="text-align: center; margin: 1rem 0;">
<img src="https://huggingface.co/spaces/oscur/README/resolve/main/Catalyzing_Urban_Computing_Community_Through_Shared_Cyberinfrastructure.png" alt="OSCUR Features" style="width: 60%; display: block; margin: 0 auto;">
<p style="font-size: 1.1em; font-weight: bold; margin-top: 0.5rem;">Unlock the Power of Urban Data</p>
</div>
<div class="alert alert-success" style="text-align: center;">
<strong to Learn More?</strong> Explore OSCUR’s potential at <a href="https://oscur.org/" target="_blank">oscur.org</a> and join the urban computing community!
</div>
<h1><span><img src="https://www.svgrepo.com/show/374627/dataset.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Datasets</span></h1>
<p class="title-icon" style="font-weight: normal;">
Through all research outputs by <code>OSCUR</code>, datasets will be used, while as much as possible striving for open-data.
Therefore, to make it easier, we host below a list of open-datasets for <code>OSCUR</code> users to more rapidly access and analyse via the
<code>Hugging Face Datasets</code> library.
To name a few, this will be including urban tabular datasets, annotated visual data, sensor readings, human behavior markers,
and other structured data tailored for urban computing scenarios. Each dataset is formatted for direct integration into machine learning workflows and visual
analytics pipelines, supporting applied research and education.
</p>
<div class="alert alert-info">
<p><strong>Note:</strong> Access our curated datasets with ease! For example, to load NYC Taxi Vis is the <code>taxisvis1M</code> dataset, use the following code:</p>
<pre><code>from datasets import load_dataset
dataset = load_dataset("OSCUR/taxisvis1M")</code></pre>
<p>Simply replace <code>taxisvis1M</code> with other dataset names to explore additional datasets. Here are some examples:</p>
<ul>
<li><strong><a href="https://huggingface.co/datasets/oscur/taxisvis1M" target="_blank">NYC Taxi –– <code>taxisvis1M</code> </a></strong>: Public New York City taxi pickup and drop-off datasets.</li>
<li><strong><a href="https://huggingface.co/datasets/oscur/NYC_311" target="_blank">NYC Service Requests –– <code>NYC_311</code> </a></strong>: 311 Service on-street Requests from 2010 to present in New York City datasets.</li>
<li><strong><a href="https://huggingface.co/datasets/oscur/pluto" target="_blank">NYC Buildings Information –– <code>pluto</code> </a></strong>: The Primary Land Use Tax Lot Output (PLUTO™) containing extensive land use and geographic data at the tax lot level in NYC.</li>
</ul>
</div>
<h1><span><img src="https://www.svgrepo.com/show/347241/open-source.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Libraries in the OSCUR Ecosystem</span></h1>
<p class="title-icon" style="font-weight: normal;">Explore the tools powering <code>OSCUR</code>:</p>
<div class="grid lg:grid-cols-2 gap-4 title-icon">
<div class="col-span-1">
<h3><img src="https://www.svgrepo.com/show/511725/collection-989.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Data Collection & Discovery</h3>
<p class="title-icon" style="font-weight: normal;">Scrape and collect urban data from diverse sources.</p>
<ul class="">
<li style="font-weight: normal;" ><a href="https://github.com/VIDA-NYU/csai-datagathering" target="_blank">CSAI Data Gathering</a> – Generate and enhance geospatial datasets for the United States Department of Transportation (USDOT) Complete Streets AI Initiative, covering Infrastructure, Traveler Behavior/Safety, and Context.</li>
</ul>
</div>
<div class="col-span-1">
<h3><img src="https://www.svgrepo.com/show/172736/transformation-of-geometric-shapes-from-cube-to-cone-outlines.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Curation & Transformation</h3>
<p class="title-icon" style="font-weight: normal;">Pre Process & Transform machine-learning-ready urban datasets.</p>
<ul class="">
<li style="font-weight: normal;" >🍳 No libraries yet, but we’re cooking something great!</li>
</ul>
</div>
<div class="col-span-1">
<h3><img src="https://www.svgrepo.com/show/340628/machine-learning-model.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Analytics & Modelling</h3>
<p class="title-icon" style="font-weight: normal;">Perform advanced analytics and machine learning on urban datasets.</p>
<ul class="">
<li style="font-weight: normal;" ><a href="https://github.com/VIDA-NYU/UrbanMapper" target="_blank">UrbanMapper</a> – Augment & Enrich plain <code>urban layers</code> using <code>urban datasets</code>' basic to ML-powered and LLM- statistics and aggregations using a <code>Scikit-Learn-like</code> urban pipeline!</li>
</ul>
</div>
<div class="col-span-1">
<h3><img src="https://www.svgrepo.com/show/340628/machine-learning-model.svg" class="feature-icon" style="display: inline; vertical-align: middle;"> Visualization</h3>
<p class="title-icon" style="font-weight: normal;">Create interactive visualizations for urban insights.</p>
<ul class="">
<li style="font-weight: normal;" >🍳 No libraries yet, but we’re cooking something great!</li>
</ul>
</div>
</div>
Let’s build smarter cities together! 🌟
Cheers,
@OSCUR team