This. It's okay to travel, just keep in mind that white supremacy is a global phenomenon. I think some of us have bought too much into the famed traveling Black Expats / pied noir narrative (James Baldwin, Richard Wright, etc.).
The State Department's Country Condition reports (which I use in my line of work) should be downloaded and read before traveling and spending your money anywhere OUTCONUS; e.g. what is a country's gay attitudes? How do they feel about immigrants (that'll give you a rough idea about Black treatment). Just read the reports with a "black eye".