Dropping rows in Dataframe: labels not contained in axis
719
December 01, 2017, at 09:15 AM
I have a table with three columns: user_id, book_id and rating. So, one row shows what rating a user gave to a book.
I'm trying to remove rows that correspond to users who rated less than 10 books. I did something similar to what is described in answers to this question Remove low frequency values from pandas.dataframe . Here is my code:
threshold = 10
value_counts = ratings['user_id'].value_counts()
to_remove = value_counts[value_counts <= threshold].index
ratings.drop(to_remove, axis=0, inplace=True)
When I run it, I get an error in the last line:
ValueError: labels [40518 21743 30824 <...> 47178 46308 30460] not contained in axis
The table has 979478 rows, so the rows with these indices should exist. What am I doing wrong?
Answer 1
Using isin, cause, the user_id is not the index , we can not using .drop here.
threshold = 10
value_counts = ratings['user_id'].value_counts()
to_remove = value_counts[value_counts <= threshold].index
ratings.loc[~ratings['user_id'].isin(to_remove),:]
-
05:30
-
04:00
-
00:00
-
10:30
-
9:10
-
07:40
Firebase Cloud Functions: PubSub, "res.on is not a function"
-
04:00
TypeError: Cannot read properties of undefined (reading 'createMessageComponentCollector')
-
9:20
-
7:40
POPULAR ONLINE
- typescript: tsc is not recognized as an internal or external command, operable program or batch file 111433 visits
- search for elements in a list 111050 visits
- In Chrome 55, prevent showing Download button for HTML 5 video 98811 visits
- RxJS5 - error - TypeError: You provided an invalid object where a stream was expected 96311 visits
- Ionic 2 - how to make ion-button with icon and text on two lines? 92506 visits
- NetBeans IDE - ClassNotFoundException: net.ucanaccess.jdbc.UcanaccessDriver 62024 visits
- Adding methods to es6 child class 22363 visits
