Your Web News in One Place

Help Webnuz

Referal links:

Sign up for GreenGeeks web hosting
September 27, 2022 11:40 am GMT

Collecting Data into Database Automatically

Import Necessary Libraries

import pandas as pdimport sqlite3import os

Get Data From Excel File

def GetData(filename):    # excel settings    try:        df = pd.read_excel(filename)        return df    except:        print('File Not Readed Filename: ' , filename)        pass    # csv settings    try:        df = pd.read_csv(filename, delimiter=',')        return df    except:        print('File Not Readed Filename: ' , filename)        pass    else:        df = pd.read_csv(filename, delimiter=';')        return df    finally:        print('CSV File Added!: ', filename)

Write Database Code

def RecordSql(dataframe, filename):    filename = str(filename).lower().strip().replace(' ', '_')    conn = sqlite3.connect('collector_database.db')    try:        dataframe.to_sql(filename, conn)        print('Table Added: ', filename)    except:        pass    conn.close()    return

Run Code

if __name__ == '__main__':    currdir = os.getcwd()    for filepath in os.listdir(currdir):        filename, ext = os.path.splitext(filepath)        if ext in ['.xlsx', '.xls', '.csv']:            print(filepath)            data = GetData(filepath)            RecordSql(data, filename)

Original Link: https://dev.to/anuoluwapods/collecting-data-into-database-automatically-6nk

Share this article:    Share on Facebook
View Full Article

Dev To

An online community for sharing and discovering great ideas, having debates, and making friends

More About this Source Visit Dev To