Yes, if the doc saw inflammation and yet prescribed no meds, then he is taking your illness too lightly. Find another doc, because untreated Cohn's leads to strictures, fistulas, abcesses, and nutritional deficiencies (because of malabsorption and/or bleeding). By the time you finally develop symptoms, permanent damage might have been done.
Now, while you have no symptoms, is the best time to find what works: the right meds and/or diet for yourself. If you wait until you are suddenly in an emergency, you might have to go right to the steroids or surgery.
The SCD diet is not inherently unhealthy. In fact just the opposite, as it includes fruits, vegies, eggs, cheese, yogurt, honey, poultry, fish, nuts, and meat. Since fruits and vegies have fiber, it is NOT a "no fiber" diet. My guess is you need to buy the book, "Breaking the Vicious Cycle," to understand the science behind the diet and to fully understand what is or isn't allowed.
Since you have no symptoms, it is going to be hard to tell whether the SCD diet is working. And, of course, you don't want to have to have a colonoscopy just to see if something is working. But what you CAN do is try the SCD diet for a few months and then have blood drawn to check inflammatory markers like CRP and ESR (otherwise known as sed rate).
It sounds like you are inventing your own diet, which can be unhealthy, especially if it is too restrictive...the breakfast you described, aside from being SCD-illegal, is meager. An SCD breakfast might include a cheese omelet, homemade applesauce, and homemade yogurt. I don't know of any bread that is SCD-legal unless it is homemade, with almond flour.
We don't know what you have for lunch or dinner, so we don't really have the whole story about your diet.