How do i get datetime into a tableau extract with pantab

Question

0

I have this code:

import pantab
import pandas as pd
import datetime
df = pd.DataFrame([
    [datetime.date(2018,2,20), 4],
    [datetime.date(2018,2,20), 4],
], columns=["date", "num_of_legs"])

pantab.frame_to_hyper(df, "example.hyper", table="animals")

which is causing this error:

TypeError: Invalid value "datetime.date(2018, 2, 20)" found (row 0 column 0)

How can I fix this?

Answer 1

Panda dtypes handle dates and strings as objects, thus you must know which columns are datetime columns. There's a universe where data scientists don't give a damn about dates, but evidently not mine. Anyway, here's the workaround till Pandas implements the date dtype:

[https://github.com/innobi/pantab/issues/100][1]

And just to reduce it down to do what I did:

def createHyper(xlsx, filename, tablename):
    for name in xlsx.columns:
        if 'date' in name.lower():
            xlsx[name] = pd.to_datetime(xlsx[name],errors='coerce',utc=True)
    pantab.frame_to_hyper(xlsx,filename,table=tablename)
    return open(filename, 'rb')

errors = 'coerce' makes it so you can have dates like 1/1/3000 which is handy in a world of scd2 tables utc = True was necessary for me because my dates were timezone sensitive, yours may not be.