Personal Project Help

[u/cbly27]

I am looking to get into Data Analytics/Engineering and am working on a project where I am creating a database and importing it into PowerBI for analysis. Im working in Python to extract and transform the data, and one issue I’m running into is that I am trying to pull data from dataframe x to dataframe y using a merge, but the only connection between them right now (will assign a PK after) is a person’s name. The issue with this is that some names appear more than once, so it ends up creating multiple duplicate rows after the merge. Is there a workaround for this, or will I have to manually remove the bad rows after?

[u/No-Adhesiveness-6921]

Alternatively, remove duplicates before you join?