This week

• [x] Check for noisy and inconsistent data
• [x] Query the correct records from the DB

Last week we found some missing values in the dataset, This week we are looking for inconsistent values and noisy data.

Let's start from the locations coordinates, when do we consider a trip not valid?

• When the pickup location is the same as the dropoff location
• When the coordinates are out of range

Pickup location equal to dropoff location

**# Find rows with pickup_location equal to dropoff_location
query = ('SELECT count(*) as number ' + 
         'FROM trip_record WHERE (pickup_latitude = dropoff_latitude) AND ' +
         '(pickup_longitude = dropoff_longitude ) ORDER BY pickup_latitude DESC')
pd.read_sql_query( query , nyc_database)

# output
422604**

Coordinates out of range

So, what is the correct range for the coordinates in Latitude and Longitude?

So as wikipedia says (https://en.wikipedia.org/wiki/Geographic_coordinate_system) the correct range for both the Latitude and the longitude is between [-180°, 180°]

But our dataset is not located around the world, we are talking about taxi of NYC, so which should be the correct range?

Well let's take a look from above

So from the map we can see that the closest states are:

• New York
• New Jersey
• Connecticut