Welcome to the community and thanks for posting! Looks like you've already gotten lots of good input from the community! Agreeing with the group, the description you describe does not sound much like a conflict of interest, which includes a public official's conflicts between private and public duties, or a conflict between competing duties. What you describe sounds more like a possible bias against you, which is an unreasoned judgment against one side in a dispute.
As others have mentioned, this is an issue you should discuss with your public defender. If you feel your public defender is not serving you well, you can try to change public defenders, or speak with a private criminal defense attorney.
Best of luck!
The FindLaw.com Team