My college degree focused on working with children with learning disabilities (Dyslexia is just one area). People who struggle with this manage to excel in many areas from programming, acting, athletics, politics etc. Because reading is more difficult, there is a tendency to focus on mathematics, but let's not confuse correlation with causation.
Programming can be a better experience not because you don't need memory or sequential skills, but most modern compilers will let you know if something is wrong. Computer languages are more literal than spoken languages (English presents many challenges.). It's not perfect, but more helpful than if you were trying creative writing although spellcheck is a benefit. My poor handwriting was saved by the computer.
What to do? Keep programming. We all develop more fluency in a language the more we use it. Practice task analysis. It doesn't have to be programming. Break down every day activities. How do you make a sandwich? Be detailed. Act like you're explaining it to a child, alien or a computer.
You may want to focus on some areas/languages that would take advantage of your visual special abilities. For databases, SQL uses more set theory than procedures. Functional languages may make more sense to your as well.
If you aren't being frustrated by programming, you aren't attempting something difficult enough. There is no getting around it. Just when you think this is easy, something will come up that will remind you, just like the rest of us, how much more you can learn.