pandas select rows based on multiple datetime columns

M_S_N :

I have two columns StartTime and EndTime, I need to select events occurring between 7-9 and 18-20. What I tried so far is this:

+------------+--------------------------------+-------------------------------+
|            |                StartTime       |            EndTime            |
+------------+--------------------------------+-------------------------------+
|        25  | 2018-05-17 11:52:21.769491600  | 2018-05-17 23:08:35.731376400 |
|        32  | 2018-05-19 14:22:24.141359000  | 2018-05-19 18:37:04.003643800 |
|        42  | 2018-05-22 08:25:01.015975500  | 2018-05-22 22:32:34.249869500 |
|        43  | 2018-05-22 08:46:06.187427200  | 2018-05-22 21:29:17.397438000 |
|        44  | 2018-05-22 13:38:37.289871700  | 2018-05-22 18:38:36.498623500 |
+------------+--------------------------------+-------------------------------+

I extracted hours from data used them to calculate following

df = df[((df['start_hr']<=7) & (df['end_hr']>=9)) | ((df['start_hr']<=18) & (df['end_hr']>=20))]

Is there a more accurate and fast alternative to it?

Diego :

It will increase your memory consumption for a while but you can do something like this where you create two temp columns and use "df.query" on them. Make sure to delete the columns later.

df = df.assign(start_hr=df.start_hr.dt.hour, end_hr=df.end_hr.dt.hour)

df.query('(start_hr <= 7  and end_hr >=9) or (start_hr <= 18  and end_hr >=20) ')

Guess you like

Origin http://43.154.161.224:23101/article/api/json?id=346306&siteId=1

pandas select rows based on multiple datetime columns

[Translation] Select multiple rows of data based on column values in Pandas

pandas select rows by condition for all of dataframe columns

select data based on datetime in pandas dataframe

MYSQL -- Split a row into multiple rows based on JSON columns

Selecting dataframe rows based on multiple columns, where new functions should be created to handle conditions in some columns

pandas iterate over rows and columns

Split columns in KETTLE into multiple rows

Moving rows in multiple columns into their own columns Python

Moving rows in multiple columns into their own columns Python

Delete multiple rows in Codeigniter by multiple columns

pandas displays all rows and columns of data

pandas gets the number of rows, columns, and elements of the dataframe

Summing Pandas columns between two rows

How to select a group by multiple columns

Convert many column into multiple columns and rows in mysql

[Python Fennel Bean Series] How does PANDAS select DataFrame rows based on column values

pandas sort columns based on time

Combining Multiple Rows in MYSQL SELECT query

Merge multiple rows into one in a pandas dataframe?

pandas dataframe adds single and multiple columns

How to pivot table in pandas on multiple columns?

pandas insert multiple columns starting at index

Pandas sort multiple columns in ascending and descending order

Pandas Dataframe - Split string into multiple columns

[Data analysis] Pandas- display all data in rows and columns in pycharm

loc and iloc functions in Pandas (extract data from certain columns or rows)

Pandas data processing basics - filter data in specified rows or columns

pandas: get rows by comparing two columns of dataframe to list of tuples

Example of Mysql splitting into multiple rows or columns by a specific symbol