An Interest In:
Web News this Week
- April 25, 2024
- April 24, 2024
- April 23, 2024
- April 22, 2024
- April 21, 2024
- April 20, 2024
- April 19, 2024
September 27, 2022 11:40 am GMT
Original Link: https://dev.to/anuoluwapods/collecting-data-into-database-automatically-6nk
Collecting Data into Database Automatically
Import Necessary Libraries
import pandas as pdimport sqlite3import os
Get Data From Excel File
def GetData(filename): # excel settings try: df = pd.read_excel(filename) return df except: print('File Not Readed Filename: ' , filename) pass # csv settings try: df = pd.read_csv(filename, delimiter=',') return df except: print('File Not Readed Filename: ' , filename) pass else: df = pd.read_csv(filename, delimiter=';') return df finally: print('CSV File Added!: ', filename)
Write Database Code
def RecordSql(dataframe, filename): filename = str(filename).lower().strip().replace(' ', '_') conn = sqlite3.connect('collector_database.db') try: dataframe.to_sql(filename, conn) print('Table Added: ', filename) except: pass conn.close() return
Run Code
if __name__ == '__main__': currdir = os.getcwd() for filepath in os.listdir(currdir): filename, ext = os.path.splitext(filepath) if ext in ['.xlsx', '.xls', '.csv']: print(filepath) data = GetData(filepath) RecordSql(data, filename)
Original Link: https://dev.to/anuoluwapods/collecting-data-into-database-automatically-6nk
Share this article:
Tweet
View Full Article
Dev To
An online community for sharing and discovering great ideas, having debates, and making friendsMore About this Source Visit Dev To