It is impressive.

One question. Why didn't you use the to_datetime() function while extrating 'hour_booked'?

I'm not sure myself but running indexing the hour part in the converted travel_time field should give you the hour.

Something like this:

df["travel_time"] = pd.to_datetime(df["travel_time"],infer_datetime_format=True)

df["hour_booked"] = df["travel_time"].dt.hour

this line of code

for x in bpf.index: b.loc[b['ride_id'].isin([x]), 'p_filled'] = bpf[x]

what are you actually calculating?

okay, thanks