You can not select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
20 KiB
20 KiB
<html>
<head>
</head>
</html>
In [26]:
import json
import pprint
import requests
import pymongo
myclient = pymongo.MongoClient(
"mongodb://user:pass@192.168.1.101:27017")
# DB
data = requests.get(
"https://raw.githubusercontent.com/lockys/Awesome.json/master/awesome/awesome.json?ref=master",
headers={"Accept": "application/vnd.github.v3+json"},
)
#
repos = data.json()
for x in repos.values():
for z in x:
try:
string = z['repo']
# if len(z['name']) > 0:
# title = z['name']
# else:
# title = "none"
# # print(count)
title = z['name']
title = title.replace(".", "")
link = string.replace("/", "-")
mydb = myclient["awesome-lists"]
mycol = mydb[title]
one_list = requests.get(
"https://raw.githubusercontent.com/lockys/awesome.json/master/repo-json/"
+ link + ".json",
headers={"Accept": "application/vnd.github.v3+json"},
)
print(title)
for x in one_list.json():
try:
mydict = x
# pprint.pprint(mydict)
new = mycol.insert_one(mydict)
# print(new.inserted_id)
except:
print(x)
except ValueError as error:
print(z)
# print("invalid json: %s" % error)
Nodejs
Nodejs - Cross-Platform
Frontend Development
iOS
Android
IoT & Hybrid Apps
Electron
Cordova
React Native
Xamarin
Linux
Linux - Containers
Linux - eBPF
Linux - Arch-based Projects
Linux - AppImage
macOS - Screensavers
macOS - Apps
macOS - Open Source Apps
watchOS
JVM
Salesforce
Amazon Web Services
Windows
IPFS
Fuse
Heroku
Raspberry Pi
Qt
WebExtensions
Smart TV
GNOME
KDE
NET
NET - Core
NET - Roslyn
Amazon Alexa
DigitalOcean
Flutter
Home Assistant
IBM Cloud
Firebase
Robot Operating System 20
Adafruit IO
Cloudflare
Actions on Google
ESP
Deno
DOS
Nix
Integration
Node-RED
Low Code
Capacitor
ArcGIS Developer
JavaScript
JavaScript - Promises
JavaScript - Standard Style
JavaScript - Must Watch Talks
JavaScript - Tips
JavaScript - Network Layer
JavaScript - Micro npm Packages
JavaScript - Mad Science npm Packages
JavaScript - Maintenance Modules
JavaScript - npm
JavaScript - AVA
JavaScript - ESLint
JavaScript - Functional Programming
JavaScript - Observables
JavaScript - npm scripts
JavaScript - 30 Seconds of Code
JavaScript - Ponyfills
Swift
Swift - Education
Swift - Playgrounds
Python
Python - Asyncio
Python - Scientific Audio
Python - CircuitPython
Python - Data Science
Python - Typing
Python - MicroPython
Rust
Haskell
PureScript
Go
Scala
Scala - Scala Native
Ruby
Clojure
ClojureScript
Elixir
Elm
Erlang
Julia
Lua
C
C/C++
R
R - Learning
D
Common Lisp
Common Lisp - Learning
Perl
Groovy
Dart
Java
Java - RxJava
Kotlin
OCaml
ColdFusion
Fortran
PHP
PHP - Composer
Pascal
AutoHotkey
AutoIt
Crystal
Frege
CMake
ActionScript 3
Eta
Idris
Ada/SPARK
Q#
Imba
Vala
Coq
V
Zig
ES6 Tools
Web Performance Optimization
Web Tools
CSS
CSS - Critical-Path Tools
CSS - Scalability
CSS - Must-Watch Talks
CSS - Protips
CSS - Frameworks
React
React - Relay
React - React Hooks
Web Components
Polymer
Angular
Backbone
HTML5
SVG
Canvas
KnockoutJS
Dojo Toolkit
Inspiration
Ember
Android UI
iOS UI
Meteor
BEM
Flexbox
Web Typography
Web Accessibility
Material Design
D3
Emails
jQuery
jQuery - Tips
Web Audio
Offline-First
Static Website Services
Cyclejs
Text Editing
Motion UI Design
Vuejs
Marionettejs
Aurelia
Charting
Ionic Framework 2
Chrome DevTools
PostCSS
Draftjs
Service Workers
Progressive Web Apps
choo
Redux
Browserify
Sass
Ant Design
Less
WebGL
Preact
Progressive Enhancement
Nextjs
lit
JAMstack
WordPress-Gatsby
Mobile Web Development
Storybook
Blazor
PageSpeed Metrics
Tailwind CSS
Seed
Web Performance Budget
Web Animation
Yew
Material-UI
Building Blocks for Web Apps
Svelte
Design systems
Inertiajs
MDBootstrap
Flask
Docker
Vagrant
Pyramid
Play1 Framework
CakePHP
Symfony
Symfony - Education
Laravel
Laravel - Education
Laravel - TALL Stack
Rails
Rails - Gems
Phalcon
Useful htaccess Snippets
nginx
Dropwizard
Kubernetes
Lumen
Serverless Framework
Apache Wicket
Vertx
Terraform
Vapor
Dash
FastAPI
CDK
IAM
Slim
Fiber
University Courses
Data Science
Data Science - Tutorials
Machine Learning
Machine Learning - Tutorials
Machine Learning - ML with Ruby
Machine Learning - Core ML Models
Machine Learning - H2O
Machine Learning - Software Engineering for Machine Learning
Machine Learning - AI in Finance
Machine Learning - JAX
Machine Learning - XAI
Speech and Natural Language Processing
Speech and Natural Language Processing - Spanish
Speech and Natural Language Processing - NLP with Ruby
Speech and Natural Language Processing - Question Answering
Speech and Natural Language Processing - Natural Language Generation
Linguistics
Cryptography
Cryptography - Papers
Computer Vision
Deep Learning
Deep Learning - TensorFlow
Deep Learning - TensorFlowjs
Deep Learning - TensorFlow Lite
Deep Learning - Papers
Deep Learning - Education
Deep Vision
Open Source Society University
Functional Programming
Empirical Software Engineering
Static Analysis & Code Quality
Information Retrieval
Quantum Computing
Theoretical Computer Science
Conversational AI
Big Data
Public Datasets
Hadoop
Data Engineering
Streaming
Apache Spark
Qlik
Splunk
Papers We Love
Talks
Algorithms
Algorithms - Education
Algorithm Visualizations
Artificial Intelligence
Search Engine Optimization
Competitive Programming
Math
Recursion Schemes
Audit Algorithms
AGI & CoCoSci
Free Programming Books
Go Books
R Books
Mind Expanding Books
Book Authoring
Elixir Books
Sublime Text
Vim
Neovim
Emacs
Atom
Visual Studio Code
Game Development
Game Talks
Godot
Open Source Games
Unity
Chess
LÖVE
PICO-8
Game Boy Development
Construct 2
Gideros
Minecraft
Game Datasets
Haxe Game Development
libGDX
PlayCanvas
Game Remakes
Flame
Discord Communities
CHIP-8
Games of Coding
Esports
Quick Look Plugins
Dev Env
Dotfiles
Shell
Fish
Command-Line Apps
ZSH Plugins
GitHub
GitHub - Browser Extensions
GitHub - Cheat Sheet
GitHub - Pinned Gists
Git Cheat Sheet & Git Flow
Git Tips
Git Add-ons
Git Hooks
SSH
FOSS for Developers
Hyper
PowerShell
Alfred Workflows
Terminals Are Sexy
GitHub Actions
Science Fiction
Fantasy
Podcasts
Email Newsletters
IT Quotes
Database
MySQL
SQLAlchemy
InfluxDB
Neo4j
MongoDB
RethinkDB
TinkerPop
PostgreSQL
CouchDB
HBase
NoSQL Guides
Database Tools
TypeDB
Cassandra
TDengine
Creative Commons Media
Fonts
Codeface
Stock Resources
GIF
Music
Open Source Documents
Audio Visualization
Broadcasting
Pixel Art
FFmpeg
Icons
Audiovisual
VLC
CLI Workshoppers
Learn to Program
Speaking
Tech Videos
Dive into Machine Learning
Computer History
Programming for Kids
Educational Games
JavaScript Learning
CSS Learning
Product Management
Roadmaps
YouTubers
Application Security
Security
CTF
Cyber Security University
Malware Analysis
Android Security
Hacking
Hacking Spots
Honeypots
Incident Response
Vehicle Security and Car Hacking
Web Security
Lockpicking
Cybersecurity Blue Team
Fuzzing
Embedded and IoT Security
GDPR
DevSecOps
Executable Packing
Malware Persistence
EVM Security
Umbraco
Refinery CMS
Wagtail
Textpattern
Drupal
Craft CMS
Sitecore
Silverstripe CMS
Directus
Plone
Robotics
Internet of Things
Electronics
Bluetooth Beacons
Electric Guitar Specifications
Plotters
Robotic Tooling
LIDAR
Open Hardware
Open Companies
Places to Post Your Startup
OKR Methodology
Leading and Managing
Indie
Tools of the Trade
Clean Tech
Wardley Maps
Social Enterprise
Engineering Team Management
Developer-First Products
Billing
Slack
Slack - Communities
Remote Jobs
Productivity
Niche Job Boards
Programming Interviews
Code Review
Creative Technology
Internships
Software-Defined Networking
Network Analysis
PCAPTools
Real-Time Communications
SNMP
Bitcoin
Ripple
Non-Financial Blockchain
Mastodon
Ethereum
Blockchain AI
EOSIO
Corda
Waves
Substrate
Golem
Stacks
Algorand
Computational Neuroscience
Digital History
Scientific Writing
Creative Tech Events
Events in Italy
Events in the Netherlands
Testing
Visual Regression Testing
Selenium
Appium
TAP
JMeter
k6
Playwright
Quality Assurance Roadmap
Gatling
JSON
JSON - GeoJSON
JSON - Datasets
CSV
Discounts for Student Developers
Radio
Awesome
{'name': 'Awesome', 'url': 'https://github.com/sindresorhus/awesome', 'repo': 'sindresorhus/awesome', 'cate': 'Miscellaneous'}
Analytics
REST
Continuous Integration and Continuous Delivery
Services Engineering
Free for Developers
Answers
Sketch
Boilerplate Projects
Readme
Design and Development Guides
Software Engineering Blogs
Self Hosted
FOSS Production Apps
Gulp
AMA
AMA - Answers
Open Source Photography
OpenGL
GraphQL
Urban & Regional Planning
Transit
Research Tools
Data Visualization
Microservices
Unicode
Unicode - Code Points
Beginner-Friendly Projects
Katas
Tools for Activism
Citizen Science
MQTT
For Girls
Vorpal
Vulkan
LaTeX
Economics
Funny Markov Chains
Bioinformatics
Cheminformatics
Colorful
Steam
Bots
Site Reliability Engineering
Empathy in Engineering
DTrace
Userscripts
Pokémon
ChatOps
Falsehood
Domain-Driven Design
Quantified Self
SaltStack
Web Design
Creative Coding
No-Login Web Apps
Free Software
Framer
Markdown
Dev Fun
Healthcare
Magento 2
TikZ
Neuroscience
Ad-Free
Esolangs
Prometheus
Homematic
Ledger
Web Monetization
Uncopyright
Crypto Currency Tools & Algorithms
Diversity
Open Source Supporters
Design Principles
Theravada
inspectIT
Open Source Maintainers
Calculators
Captcha
Jupyter
FIRST Robotics Competition
Humane Technology
Speakers
Board Games
Software Patreons
Parasite
Food
Mental Health
Bitcoin Payment Processors
Scientific Computing
Amazon Sellers
Agriculture
Product Design
Prisma
Software Architecture
Connectivity Data and Reports
Stacks
Cytodata
IRC
Advertising
Earth
Naming
Biomedical Information Extraction
Web Archiving
WP-CLI
Credit Modeling
Ansible
Biological Visualizations
QR Code
Veganism
Translations
Scriptable
WebXR
OpenStreetMap
Computational Biology
All Awesome Lists
{'name': 'All Awesome Lists', 'url': 'https://github.com/topics/awesome', 'repo': 'topics/awesome', 'cate': 'Related'}
Awesome Indexed
{'name': 'Awesome Indexed', 'url': 'https://awesome-indexed.mathew-davies.co.uk', 'repo': 'undefined/undefined', 'cate': 'Related'}
Awesome Search
{'name': 'Awesome Search', 'url': 'https://awesomelists.top', 'repo': 'undefined/undefined', 'cate': 'Related'}
StumbleUponAwesome
Awesome CLI
Awesome Viewer
{'name': 'Awesome Viewer', 'url': 'https://awesome.digitalbunker.dev', 'repo': 'undefined/undefined', 'cate': 'Related'}
Track Awesome List
{'name': 'Track Awesome List', 'url': 'https://www.trackawesomelist.com', 'repo': 'undefined/undefined', 'cate': 'Related'}
In [13]:
import pymongo
myclient = pymongo.MongoClient("mongodb://user:pass@192.168.1.101:27017")
# DB
mydb = myclient["awesome-lists"]
# Collectinon
mycol = mydb["test"]
mydict = {"name": "Peter", "address": "Lowstreet 27"}
x = mycol.insert_one(mydict)
print(x.inserted_id)
print(mydb.list_collection_names())
63136ab944dfc9e0de996f01 ['test']
In [ ]:
!pip install pymongo