"The" top Ivy? :) Is there such a thing? I went to Harvard, as well (I assume you went to Harvard based on your use of the term "concentration"), but I'm not sure I would call it "the" top Ivy....
Anyway, all kidding aside...
Not to be facetious, but I think you already know the answer to your question, since you correctly noted that "the whole profile is taken into consideration."
AdCom is sophisticated enough to realize that a given grade (e.g., a B) will have different meaning/significance depending on how much the specific course and school are known for their rigor and competitiveness. There is a big difference between, say, getting a B in MIT's Stochastic Calculus course and getting a B in Pre-Calculus at a small, unaccredited community college (to provide an extreme example). There is also a difference between grades across the Ivies, depending on which course is taken.
This realization, and other contextual elements, are factored into the bigger picture evaluation of how capable and ready a candidate is for the Wharton MBA program. Thus, I cannot say, at this stage, whether or not the quant scores would hurt your chances. What I will point out, though, is that if your transcript suggests a general trend of relative weakness in quantitative subjects, it cannot hurt to be proactive and make clear in the rest of your application that you can still be quantitatively strong and rigorous.
At this stage, since the classes are already completed and are thus moot, I wouldn't worry about them and just concentrate on doing well on the GMAT (and especially on the Q subsection). Once you have your GMAT subscores, there will be a bit more information available to draw a sharper picture.