Journal editor admits involvement in Ermakova "set-up"

Gathered together in one place, for easy access, an agglomeration of writings and images relevant to the Rapeutation phenomenon.

Re: Journal editor admits involvement in Ermakova "set-up"

Postby admin » Sun Jan 24, 2016 9:54 am

Nature Biotechnology 25, 1356 - 1358 (2007)



Response to GM soybeans—revisiting a controversial format

Bruce Chassy, Vivian Moses, Alan McHughen & Val Giddings respond:

We limit our comments here primarily to the issues relating to Ermakova's experiments and findings in the order in which she raises them in her letter.

Although Ermakova states that she received “soy clearly labeled as GM and non-GM soy,” she still has not established the identity of the material tested, which is of paramount importance to an animal feeding study. The methodology and materials described by Ermakova are fatally flawed in several additional respects and as a consequence invalidate the experimental results. One of the basic issues is the content of the feed. The Archer Daniels Midland (ADM) catalog states and B.C. contacted ADM on October 20 and November 5, 2007, to verify that they do not sell—and have never sold—a 100% GM-soy product containing the RR-40-3-2 line to which Ermakova refers.

We must nevertheless apologize to Ermakova (and to readers) for any confusion that may have resulted from a typographical error in the statement she quoted from page 981—we can understand her confusion about our intended meaning. Our statement should have read: “the best that can be said is that commercial products sold by ADM would have been an indeterminate and variable mixture of conventional and GM soybeans.” Our point was that commercial products not specifically labeled GMO free are unsegregated mixtures of numerous varieties of conventional and GMO beans; Ermakova therefore had no measure of how much GM content was fed to the animals. The market has many varieties, each of which has its own unique composition and properties. This is why it is necessary to ensure that comparisons are between isogenic or even near-isogenic varieties; comparison of like varieties is a prerequisite for animal studies.

The PCR results she reports in Figure 1 do not demonstrate that the so-called GM soybean was 100% transgenic because Ermakova claims only that all samples (100%) of Arcon SJ tested positive by PCR. This is not the same as demonstrating that the positively testing sample is 100% transgenic soybean; all the samples might have had a small GM content so that all would have tested positive. It is essential to determine the percentage of GM-soybean content of the test materials both to allow others to attempt to replicate the procedures reported as well as to allow the actual exposure to GM-soybeans to be calculated.

Ermakova is comparing results obtained using different and uncharacterized soybean fractions. In one case, she fed ground soybean flour and compared that with results obtained using a protein concentrate (Arcon SJ). She refers to Arcon SJ as 100% transgenic soybean flour, which is incorrect; it is a concentrate, which is inconsistent with the claim that concentrates produced much less dramatic results.

There is also a much larger issue here: the composition of a sample of soybeans (or of any crop plant for that matter) is highly dependent on the location and conditions under which it was grown and harvested. Good practice dictates the cultivation of GM and non-GM soybeans in the same or adjacent fields to reduce soil and positional differences that might affect the composition. To overcome seasonal variation, the soybeans should be cultured in the same year.

It is of particular importance to note that isoflavone content varies between varieties, site of cultivation and growth year1. A point that we noted previously is that isoflavones have estrogenic activity that can dramatically affect the outcome of animal studies; neither was tested or controlled in her study.

As Ermakova thanks us for our detailed analysis of her work, we would also like to make the following suggestion. Guidelines describing the proper methods of preparing crop materials for animal studies were published this year by the International Life Sciences Institute (Washington, DC, USA) and are free online2.

We thank Ermakova for clarifying that extra soy was provided to males and females during mating; however, we would be interested in her response to a more fundamental problem that we noted in the original article. In all of her experiments, she housed three female rats together and fed them animal chow and soy product in separate dishes. That experimental design does not allow one to measure how much soy and chow each animal consumed. This information is essential, without which no scientific conclusion can be drawn. As in the original Feature, we refer Ermakova to the internationally accepted guidelines for performing animal feeding studies published by the Organization for Economic Cooperation (OECD; Paris;

Ermakova mentions that her protocol was different from that of Brake and Evenson3. Indeed, Brake and Evenson started with 18 animals and sacrificed them in groups of 3 over an 87-day period. Their protocol observed all international guidelines and norms and would have detected effects of the magnitude that Ermakova observed. Their paper can be used as a model of how to conduct a reproductive toxicology study: Brake and Evenson had a known field source of soybeans, reported the exact composition of the diet and, because they fed the animals a single preparation containing test or control materials and measured weight gain, they could have interpreted any differences in weight gain. No differences in weight gain and no pup mortality were observed by them. Brake and Evenson studied four generations and, contrary to Ermakova's claim, animals were exposed to soy throughout the life cycle.

Ermakova compared her animal study with human-based clinical trials. Humans are not genetically homogenous and as a rule produce results showing considerable variation. The inbred laboratory rat is quite the opposite of a human in this regard; it has been developed to perform studies that will result in small variances of the measured variables. It is not good practice to pool results from separate animal studies because individual lots of animals can and do differ, and reproducing diet and environmental conditions is difficult at best. Thus, results from animal studies are normally not pooled; instead, statistics derived from each group are compared. Doing so increases the variance of measured variables.

The numbers of animals used in the study and the means and variances Ermakova now report for the body weights of males and females do not correlate with the data she reported in Table 3 in the original Feature published by Nature Biotechnology. The data in the Feature showed a wide variation in weight gain for all three groups; the new means and variances she now reports cannot be produced from the original data in Table 3. In the Feature, Ermakova's three conclusions for the GM soy-fed rates she observed were: (i) higher pup mortality; (ii) lower weight gains; and (iii) poor reproductive performance. The current data seem to contradict her original claim of reduced weight gain.

The weight gains reported in the controls are uncharacteristic of well-established literature averages for the Wistar rat. We interpret this as an indication of diet or environmental problems. Such wide variance in growth rates and the high control–death-rates are red flags signaling problems in experimental procedure.

The reporting of external variables that can affect behavior is good practice. The use of accredited facilities with standardized parameters not only ensures optimal health and development of the subject animals, it facilitates the comparison of results between experiments. We are still not sufficiently reassured by Ermakova's responses that environmental conditions were homogeneous throughout the animal facility where she carried out her experiments.

Ermakova now presents behavioral data from her feeding experiments, but doesn't mention if the studies were blinded. Because we still have serious concerns about the nourishment and treatment of the animals used, we cannot comment on her results. Ermakova's claims that GM soybeans have higher isoflavone notwithstanding, we cite published research demonstrating that, whereas soy isoflavone content varies considerably between varieties and harvests, GM soybeans have the same content of isoflavones as conventional soybeans4, 5.

In responding to our point in the Feature that several previous papers3, 6, 7 contradict her results, Ermakova claims they “had a different aim...and thus they are not comparable.” We respectfully disagree and do not see this as a basis for rejecting the feeding studies that we cited. These are well-conducted, peer-reviewed studies that exposed animals to diets containing a high content of soy or GM soy. Ermakova goes on to cite three papers from one group8, 9, 10 that have reported adverse effects of GM soy on testes and livers. We feel it is important to stress here that unlike the studies we cited3, 6, 7, the reports from Malatesta and colleagues8, 9, 10 do not conform with established international standards and protocols and fail to document the source, the composition or the identity of the soybeans under study. But in contrast to Ermakova, these authors8, 9, 10are scientifically cautious about the biological significance of their observations. We suggest that readers compare the literature we have cited with the three papers to which Ermakova refers and make a judgment for themselves about the effects of GM soy.

Ermakova goes on to state she carried out the experiments under conditions that were “as close to natural” as possible and concedes that no evidence is available as to the cause of pup death. It is pro forma in animal studies to determine the cause of death. Laboratory animal studies are not intended to mimic nature. The white laboratory rat does not exist in nature: it was bred in a laboratory to be used in very standardized studies designed to reduce variability and minimize uncontrolled variation that might confound the results.

Ermakova contends that the Brake and Evans study3, which contradicts her results, is not relevant because the feeding regime was “completely different” from the one used in her experiments, and suggests this is of significance because “only embryonic cells in the womb” would be affected by the EPSPS gene sequences, not the “sexual cells and/or organs before and during mating.” As we note above, the whole-life, four-generational nature of the Brake and Evenson3 study and its rigorous design cannot be disregarded. National and supranational regulatory agencies working in the public interest all over the world have examined extensive animal study data on GM soy and concluded it is as safe as, or safer than, conventional soy.

With regard to the data in Table 5 of the Feature: the litter size we computed from Ermakova's Table 5 as printed is that 12 dams produced 72 pups, which computes to six pups per dam, as we stated. A control group litter size value of eight does not improve the situation, because this is 50% below the normal litter size and a sign of animals in distress. With such high mortality and stunted growth, we must ask how normal reproductive experiments could have been performed with the GM soy-fed mice.

We leave Andrew Marshall to respond to the questions raised about the publication process, but we strongly object to Ermakova's characterization of us as 'pro-GM' scientists and in particular Brian John's slander that we are “apologists for the GM industry.” It is a matter of public record that we declare no conflict of interest, save for V.M., who maintains a GM information website that does receive some funding from industry and L.V.G. who works as a consultant with some industry clients (none of which are involved in transgenic soy). Contrary to the correspondence presented here, the scientists with whom we have spoken and from whom we have received letters in regard to this matter have expressed their appreciation to us for trying to correct the misinformation contained in Ermakova's 2005 report. B.C., A.M. and V.M. are, or have been, university faculty whose mission is the apolitical and objective teaching of science. None of us characterize ourselves as 'pro-GMO' or 'anti-GMO' as a matter of philosophy. It is an issue on which we remain agnostic; rather, we characterize ourselves as 'pro-science', 'pro-environment' and 'pro-humanity'.

All scientific work can and should be subject to the full force of reasoned criticism. Ermakova's remarks that there is an industry conspiracy to criticize and suppress articles containing evidence of the negative effects of GMOs is refuted by Ermakova herself when she cites published work on GMOs (albeit flawed) that shows negative effects. Rather than a worldwide conspiracy, we deduce there are few publications showing harm because GM soy is safe and does not cause harm.

We conclude then, that Ermakova's research relied on experimental designs that fall short of internationally accepted norms, with animals handled in such a way that even control lines were negatively affected. The feeding studies used materials that were characterized inadequately, incorrectly or not at all. Thus, no scientific conclusions can be drawn from the work.

We must stress again that GM soy has been thoroughly studied in the peer-reviewed literature, by regulators around the globe and by the cruel testing place of the real world. More than 500 million hectares were cultivated over the past decade. Much of this has been fed at high concentration to domestic animals, poultry and fish. There have been no reports of stunted growth or reproductive failure as one might expect if Ermakova were correct.

Competing interests statement

Declaration of competing financial interests
From the following article
Response to GM soybeans—revisiting a controversial format
Nature Biotechnology 25, 1356 - 1358 (2007)
back to article
Declaration: V.M. notes he is the chariman of CropGen (London), an information service directed at informing the UK public about agricultural biotechnology, which receives limited support from the biotech industry but acts entirely independently ( V.G. was employed for eight years by the Biotechnology Industry Organization in the past and now works as a consultant with some industry clients, none of which are involved in transgenic soy.


1. Eldridge, A.C. & Kwolek, W.F. J. Ag. Food. Chem. 31, 394–396 (1983). | Article | ChemPort |
2. <>
3. Brake, D.G. & Evenson, D.P. Food Chem. Toxicol. 42, 29–36 (2004). | Article | PubMed | ISI | ChemPort |
4. Padgette, S. et al. J. Nutr. 126, 702–716 (1996). | PubMed | ISI | ChemPort |
5. Mebrahtu, T., Mohamed, A.I., Wang, C.Y. & Andebrhan, T. Plant Foods for Human Nutr. 59, 55–61 (2004). | Article | ChemPort |
6. Teshima, R. et al. J. Food Hyg. Soc. Japan. 41, 188–193 (2000). | Article | ISI | ChemPort |
7. Zhu, Y., Li, D., Wang, F., Yin, J. & Jin, H. Arch. Anim. Nutr. 58, 295–310 (2004). | Article | PubMed | ISI | ChemPort |
8. Malatesta, M. et al. Cell Struct. Funct. 27, 173–180 (2002). | Article | PubMed |
9. Malatesta, M. et al. Eur. J. Histochem., 47, 385–388 (2003). | PubMed | ChemPort |
10. Vecchio, L., Cisterna, B., Malatesta, M., Martin, T.E. & Biggiogera, B. Eur. J. Histochem. 48, 449–453 (2003).
Site Admin
Posts: 17163
Joined: Thu Aug 01, 2013 5:21 am

Re: Journal editor admits involvement in Ermakova "set-up"

Postby admin » Sun Jan 24, 2016 9:56 am

Nature Biotechnology 25, 1359 - 1360 (2007)



Response to GM soybeans—revisiting a controversial format

Andrew Marshall responds:

The September Feature was a new format for Nature Biotechnology. My aim in publishing this Feature was to provide an informative presentation of the science behind Ermakova's work, the problems posed by publicizing original data to the media without first publishing it in the peer-reviewed literature, and to open this particular debate to a wider audience. Indeed, many investigators who were unaware of her results now have an opportunity to build on her work and attempt to reproduce it. As I indicated to Ermakova in my original e-mail invitation to her (see Supplementary Materials 1 online), I felt that the biotech community would best be served if she had the opportunity to present her findings and conclusions in her own words—findings and conclusions that could not be published in Nature Biotechnology because of her decision to publicize them in other forums.

As Nature Biotechnology went to press, 20 letters had been submitted to the journal and several directly to the management of Nature Publishing Group concerning the format of this Feature and the process by which it was commissioned. Three letters applauded the journal for a useful and informative analysis of science that had been previously published without peer review. But the vast majority of letters were critical, repeating the points raised here by Irina Ermakova; we have printed above only those letters that present additional concerns.

There appears to be confusion about the way in which this Feature was conceived, commissioned and produced. There is a perception in some quarters that the Feature ultimately published in Nature Biotechnology is the same as a Commentary originally submitted to the journal by Val Giddings. This is not the case. I elected to decline to publish this original Commentary because the critique of Ermakova's work presented was based on data from publicly available sources, which may or may not have been reliable.

Ermakova's existing data were ineligible for peer-reviewed publication because she and others (including Brian John) had already promoted publicly the 2005 data before they received careful scrutiny in a peer-reviewed journal. She had distributed them widely in reports and discussed them with journalists. This contravenes our prepublication policy ( ... ality.html). I strongly support this policy. Peer-reviewed publications are the places to publish scientific advances—not press releases, newspapers or postings on the internet. This prepublication policy is shared by all Nature journals and other top-tier science journals. This was made clear to Ermakova several times in our correspondence (see Supplementary Materials 1 online). As Bruce Chassy, Giddings, Alan McHughen and Vivian Moses (Chassy et al.) point out in the September Feature, and Stewart1 has commented in our pages previously, circumventing peer review can have pernicious consequences for the public perception of science.

To provide readers with the most informative article on Ermakova's controversial work, I elected to go directly to her and asked whether she would be willing to describe her work in her own words and to pursue publication in the form of a Feature. My concept was to pose questions to Ermakova and then have a group of researchers respond to her answers. This was explained to Ermakova in the original commissioning e-mail (see Supplementary Materials 1 online).

Because of the controversy surrounding the work, I felt the readers would be interested in a presentation of Ermakova's results in the context of a scientific analysis. Including comments from established scientists was important because to my knowledge her results had not been presented in the context of a skeptical scientific analysis anywhere before.

A concern expressed in the Correspondence by Ermakova and in many letters received by the journal is that the researchers invited to comment on Ermakova's work did not comprise a representative sample of the broad range of views of scientists. On the contrary, Chassy, Moses and McHughen have established publication records, have thought deeply about Ermakova's results, are qualified to discuss their societal impact and can assess the data on the basis of established scientific norms. In drawing up his response, Chassy also consulted with an expert in the field of animal toxicology. In addition, Giddings is a recognized expert and consultant in biotech with respect to policy and regulations. I would also like to point out that contrary to Joe Cummins' assertion, I have no interest in, and never have been, in the field of “public relations on behalf of the biotech industry.”

As Chassy et al. point out, a 'pro-GM' or an 'anti-GM' position is inherently unscientific. I wholeheartedly concur with this viewpoint. The safety and efficacy of any product should be assessed on a case-by-case basis, not according to the method by which it was produced. I am also struck that none of the correspondence elicited by the article has taken issue with the validity of the scientific criticisms made, only the identity of the authors who made them.

I sent Ermakova an initial set of 17 questions, to which she responded. These questions and answers were then forwarded to Giddings and Chassy, who conferred with Moses and McHughen. Their responses were appended to Ermakova's answers and I wrote an introduction explaining why we were publishing the Feature. In the galley proofs seen by Ermakova (Supplementary Materials 2 online), some questions had already been merged and one of the original questions ('What mechanisms do you think might underlie the health effects you observe in your study?') had been removed for conciseness and space constraints. During editing, I dispensed with the question and answer about mechanisms (question number 13 in Supplementary Materials 1 online) as I felt it was unnecessary and inappropriate to speculate on the mechanism of the defects reported by Ermakova, given the serious concerns raised by Chassy et al. over the rigor of the science and the design of the experimental protocol. It turns out that this question is the part of her original draft that contained the references she mentions were removed and gave the impression of her work as “inferior and unsupported by the literature in comparison to the critiques.” Ermakova has now cited some of these omitted references in her letter above; for the rest of the originally cited papers, readers are referred to the list below2, 3, 4, 5, 6, 7.

Ermakova's other concerns related to the editorial process. She asks why I refused to publish new unpublished data from her laboratory, while at the same time assembling and publishing an article that is “a brutal attack on her results.” This is conflating two separate issues, the journalistic criteria for publishing a Feature with the editorial criteria applied to selecting papers for peer review in the Research section. The Feature tackled Ermakova's original 2005 results because of their societal impact and the public attention they garnered when originally circulated widely over the internet and in the media. In contrast, research papers are selected by the journal's editors for evaluation by outside experts on the basis of whether the findings reported are novel, a significant advance over previous work and of sufficient interest to a broad audience. As stated above, Ermakova had disqualified her 2005 data from the latter process by not conforming with our prepublication policy.

I indicated to Ermakova that Nature Biotechnology would be willing to consider any new data she had obtained, and I suggested she submit a presubmission enquiry to the journal. The presubmission enquiry was evaluated by one of our editors, who felt that the results would be better published elsewhere. Ermakova is still welcome to submit the full paper to us; however, promises of being selected for peer review are not made to authors at the presubmission stage. Publication of a journalistic Feature focusing on Ermakova's previous work cannot in any way influence decisions to send new research out for peer review, unless we deem it appropriate according to our editorial criteria for research papers.

Another point raised by Ermakova and by Brian John is that she was sent a 'publication proof' that showed her name as the author. This was a mistake made by Nature Biotechnology when generating the proofs, which I did not check before they were sent to Ermakova. Her name was mistakenly placed on the proof, which contained my introduction and her responses to my questions, but not the comments of Chassy et al. (Supplementary Materials 2 online) The proof was thus much different from the form we had discussed for the final published article (containing comments from other scientists). Clearly, this was confusing and led Ermakova to believe she would be the sole author of the piece.

I accept full responsibility for not reconfirming with Ermakova what I had explained in my original e-mail to her, that her responses were to be part of a larger Feature, and that I would be the author of this journalistic piece. Again, I believe many of the misunderstandings here have arisen due to a wrong perception—both by Ermakova and other correspondents to this journal—that the September Feature is a peer-reviewed research paper, rather than journalistic content.

Ermakova's charge that she never saw the final remarks of Chassy et al. or my introduction to the article also reflects a misunderstanding of the publication process for content that is not peer-reviewed research. The Feature we were preparing on Ermakova's work was intended to be a journalistic Feature for the magazine section of Nature Biotechnology. Like other purveyors of news content who conduct interviews and then publish articles based on the content, there is no precedent for revealing the names or comments of the other contributors to an article. This is standard practice for Nature Biotechnology, other Nature journals and for journalistic content in general. In these circumstances, it is the editor's responsibility to faithfully reproduce the remarks made by the interviewed parties.

There are several take-home lessons from this first experience, if Nature Biotechnology were to repeat this unusual format in the future. We will do a better job ensuring that all authors grasp the process from the start, including authorship and issues surrounding comments made in any interviews. Although I regret that Ermakova misunderstood our publication process, at no time did I indicate that she would be given full authorship of the Feature or that she would see the critiques of the researchers or learn their identities. The key e-mail correspondence between Ermakova and me is presented in Supplementary Materials 1 online so readers can make up their own minds about the quality of the communication process.

In the future, it would be better practice to ask single scientists with particular expertise to respond to different questions rather than publish their comments as a group. In the format published in the September Feature, the comments from Ermakova were appended with collective comments from Chassy et al. In his letter, John raises the point that no one takes “full responsibility” for collective responses. This is one aspect that many of our correspondents found particularly distasteful.

With hindsight, a more thorough editorial effort should be undertaken to ensure that authors whose work is being commented upon have sufficient opportunity to respond to criticisms that are based on insufficiency of data provided. Although I had asked Ermakova to show more behavioral data in response to questions raised by Chassy et al., several other comments in the published text criticized her for not providing other data, to which I gave her no opportunity to respond. That said, Ermakova has now had a full opportunity in these pages to respond to all the comments in full.

I would certainly welcome feedback from readers as to ways in which this Feature format could be improved in the future. One question is whether it is appropriate for a journal to allocate pages in the form of a full research article (as Leifert, Traavik and Heinemann suggest I should have done for Ermakova's experiments) when the primary criteria for editorial selection is the unusual societal and regulatory impact of the work, rather than its scientific quality or impact. Perhaps one solution for such papers would be for their listing on prepublication servers that allow community comment in an open manner and in a neutral environment (e.g., Nature Precedings, Unlike public release in the media, this would not preclude later publication in a journal. I invite readers to make suggestions for ways to present work that has circumvented the traditional peer review process but is nevertheless of interest to the wider research community and public.

Note: Supplementary information is available on the Nature Biotechnology website.


1. Stewart, C.N. Nat. Biotechnol. 21, 353–354 (2003) | Article | PubMed | ISI | ChemPort |
2. Pusztai, A., Grant, G., Bardocz, S., Gelencser, E. & Hajos, G. Br. J. Nutr. 77, 933–945 (1997). | Article | PubMed | ChemPort |
3. Richard, S., Moslemi, S., Sipahutar, H., Benachour, N. & Seralini, G.E. Environ. Health Perspect. 113, 716–720 (2005). | PubMed | ChemPort |
4. Rang, A., Linke, B. & Jansen, B. Eur. Food Res. Technol. 220, 438–443 (2005). | Article | ChemPort |
5. Wilusz, C.J., Wang, W. & Peltz, S.W. Genes Dev. 15, 2781–2785 (2001). | PubMed | ISI | ChemPort |
6. Hirotsune, S. et al. Nature 423, 91–96 (2003). | Article | PubMed | ISI | ChemPort |
7. Windels, P., Taverniers, I., Depicker, A., Van Bockstaele, E. & De Loose, M. Eur. Food Res. Technol. 231, 107–112 (2001). | Article |
Site Admin
Posts: 17163
Joined: Thu Aug 01, 2013 5:21 am

Return to A Growing Corpus of Analytical Materials

Who is online

Users browsing this forum: No registered users and 3 guests