Friday 14 October 2016

Batch effects in scRNA-seq: to E or not to E(RCC spike-in)

At the recent Wellcome Trust conference on Single Cell Genomics (Twitter #scgen16) there was a great talk (her slides are online) from Stephanie Hicks in the @irrizarry group (Department of Biostatistics and Computational Biology at Dana-Farber Cancer Institute). Stephanie was talking about the recent work she's been doing looking at batch effects in single-cell data, all of which you can read about in her paper is on the BioRxiv: On the widespread and critical impact of systematic bias and batch effects in single-cell RNA-Seq data. You can also read about this paper over at NExtGenSeek.

Adapted from Figure 1 in Hicks et al.


Almost without exception every new technology gets published with a slew of high-impact papers. And almost without exception those papers turn out to be heavily biased. This is not to say we should expect every wrinkle to be ironed out before initial publication - new technologies take a lot of effort and the faster they make it into the public domain the sooner the community can improve them and make them more robust. Often batch effect is the first problem identified: with arrays, with NGS, and now with single-cell RNA-seq.

Stephanie et al looked at 15 published single-cell RNA-seq papers and found that in the 8 studies investigating differences between group, and where they could assess confounding effect it ranged from 82.1% to 100% (see table 1 from the paper - 82,85,93,96,98,100 & 100%). All of these studies were designed such that the samples were confounded with processing batch. They report that the number of genes detected expressed explained a significant proportion of observed variability, but that this varied across experimental batches. This confounding of biological question with experimental batch effectively cripples the project; 


"Batch effects lead to differences in detection rates, which lead to apparent differences between biological groups"

However the authors do point out that relatively simple experimental design choices can be used to remove the problem.


What does this mean for ERCC and other spike-ins : In her final slides, see "The Wild West", Stephanie clearly explains the problems we face with batch effects and in normalising single-cell RNA-seq experiments.
  • Batch effects can be a big problem in scRNA-Seq data (but not always). 
  • Batch effects and methods to correct for batch effects have been around for many years (lots of places to start). 
  • Bad news: Poor experimental design is a big liming factor…. also, more complicated because of sparsity (biology and technology), capture efficiency, etc
  • Good news: Increase awareness about good experimental design. New methods specific for scRNA-Seq are being developed
It is looking more and more possible to use RNA spike-in's in scRNA-seq experiments specifically as a tool to help in the normalisation of the data, and also as a way to reduce/remove batch effects. Stephanie does state that there are still challenges in doing this, and also points to the use of UMI counts to help fix the problem by reducing amplification bias, etc.

However not every protocol recommends spike-in's and there is certainly no clear preference in the community - although I think this is beginning to emerge.  Read about how ERCC's & SIRVs are being used in single-cell RNA seq in the latest paper from Sarah Teichmann’s group at EBI/Sanger.

I'm putting effort into understanding spikes in a lot more detail and am sure we'll all be using them routinely in a few more months.

What does this mean for the choice of scRNA-seq platform: My briefest of surveys for the three platforms we're using or looking at in my lab are as follows. Fluidigm suggest using the ArrayControl RNA Spikes (Thermo Fisher Scientific AM1780). Drop-seq suggest using the ERCC spikes (although this is not mentioned in their online protocol). 10X Genomics don't say anything about spikes in their current protocols!

I generated the figure at the top of this post to show where these 3 scRNA-seq platforms fit into Stephanie's figure 1 from the paper. Both C1 and Drop-seq are completely confounded as only one sample is processed per batch. 10X Genomics allows up to 8 samples to be processed together so a replicated "AvsB" study could be completed with zero batch effect.

But in the future we're likely to need 12, 24 or even 96 sample systems that allow us to process a scRNA-seq experiment in one go. Whilst it may well be possible to design Fluidigm C1 chips that can process more samples, each with fewer cells, or for Drop-seq to emulate 10X Genomics, or even for 10X Genomics to move to a larger sample format chip; none of this will solve the problem of collecting large numbers of single-cell samples without introducing batch effects further upstream in the experiment.


The take home message is to spend time on experimental design, and to replicate your study - simple enough stuff! Biological replication will allow batches to be randomised during the experiment to scRNA-seq prep runs and across sequencing flowcells if necessary. This generally allows batch effects to be removed from the experiment, even if they are significant.

6 comments:

  1. Appreciation is the key to doing more that is why I have took some time out to thank some one who cured me of my 2 years HEPATITIS B problem. It became a major problem to me as it was affecting my marital life and I was no longer comfortable so I decided to look for a solution and I came across a post of Dr Ariba and how he has been helping people of the same problem I contacted him and told him all I have been facing in my life. He told me how to get his product and how to take it after every thing I find out that all was now okay with me and that my HEPATITIS B problem was gone that is why I have come out today to say thank you to him . if you need cure for HIV/AIDS, Herpes, cancer or diabetes of all types you can contact his email draribaspelltemple@gmail.com OR draribasolutioncenter@yahoo.com
    Whatsapp: +2348140439497

    ReplyDelete
    Replies
    1. REUNITE YOUR MARRIAGE, RELATIONSHIP,SUCCESSFUL LOTTERY SPELL RESULTS, CURE ALL KINDS OF DISEASE AND WEAK ERECTION

      Stop asking for another chance, stop questioning what you could have done differently, and – most importantly – stop second-guessing your own self-worth. Once you Come Back To My Spell is performed, the balance of desire will shift and your lover will be begging you to take him or her back. This Love Spell Could Work For You!Bring back the good times. Think about the happiest time in your relationship, and i can make it happen again. You deserve to be happy.

      Are you looking for ultimate spells that works effectively same time on your problems, ranges from Love spells, marriage spells, and carrier related problems, witchcraft spells, charms, portion, talismans, magical oils / powders, protection, legal court cases, business prosperity spell, Gay and lesbian extreme love / attraction spells, women of the night Norton accruing powders and oil for extreme ecstasy and protection with in working ordeals.

      My powerful lottery spells, will bring you the huge wins, and jackpots you desire and need. I work my lottery spells, to bring great luck. The power of my lottery spells, works on you, so there are no special numbers needed to play, or certain patterns. Just play one ticket on the lottery of your choice, and the powerful lottery spell will handle the rest. Whether you play Power-ball, Mega Millions, daily drawings or sweepstakes. I have a powerful lottery spell, to help you. Working with my spirit guides, to clear bad luck, and infuse you with good luck and positive energy energy. The power of my lottery spells, brings luck, and wins fast. Clearing paths with-in the universe, for money and great luck to reach you. These powerful spell castings, will be successful in bringing the lottery wins, to change your life.

      Email: POTENTIALSPELLTEMPLE@GMAIL.COM

      OR


      POTENTIALSPELLTEMPLE@YAHOO.COM

      Delete
  2. My Name is Abigail, and am really grateful and thankful for what Dr. ARIBA has done for me and my family. I Was having HIV/ AIDS for good three years with no solution, the diseases almost took my life and cause I was unable to work and I was also loosing lots of money for medication, but one faithful day when I went online, I met lots of testimonies about this great man so I decided to give it a try and to God be the glory he did it. he cured me of my diseases and am so happy and so pleased to Write about him today. if you need his help of you also want to get cured just the way I got mine, just email draribaspelltemple@gmail.com or dr.aribasplltemple@outlook.com,Whatsapp;+2348140439497 and get your healing. He has cure for other deadly diseases like Diabetes, Herpes, Hepatitis of all types and Cancer.

    ReplyDelete
  3. WHEN ALL HOPES IS LOST MEDICALLY TO THE CURE OF MY HERPES THE ONLY AWAITING SOLUTION I NEVER KNEW IS DR OGUDU SPELL TEMPLE. FOR THOSE WHO ARE STILL SHARING MY PREVIOUS HOPE IN MEDICAL CURE AS A SOLUTION TO YOUR CURE SHOULD STOP SEARCHING AND GO TO DR.OGUDU FOR INSTANT CURE. CONTACT HIM NOW WITH THE FOLLOWING DETAILS EMAIL ADDRESS [OGUDUSPELLTEMPLE@YAHOO.COM] WHATSAAPP NUMBER +2348106058254 Website---http://oguduspelltemple.wixsite.com/drogudu


    Am COREY ANN from URUGUAY i was suffering from genital herpes, oral herpes, shingles. Before i came in contact with dr.ogudu
    It is no longer news that the Acquired immune deficiency syndrome Herpes Virus is increasing by the day, The fear is that many people living with the sickness are scared of saying it because of the stigma that comes along with it.I am bold enough among many others to state that there is now a potent cure to this sickness but many are unaware of it.I discovered that I was infected with the virus 3 months ago, after a medical check-up. My doctor told me and I was shocked, confused and felt like my world has crumbled. I was dying slowly due to the announcement of my medical practitioner but he assured me that I could leave a normal life if I took my medications, In a bid to look for a lasting solution to my predicament, I sought for solutions from the voodoo world. I went online and searched for every powerful trado-medical practitioner that I could severe, because I heard that the African Voodoo Priests had a cure to the Herpes syndrome. It was after a little time searching the web that I came across one Dr.Ogudu website who offered to help me, He gave me some steps to follow and I meticulously carried out all his instructions. Two days ago to be precise, I went back to the hospital to conduct another test and to my amazement, the results showed that " I am NEGATIVE" You can free yourself of this Herpes virus by consulting this great African Voodoo Priest via this EMAIL [OGUDUSPELLTEMPLE@YAHOO.COM] WHATASPP NUMBER +2348106058254

    ReplyDelete
  4. Great blogpost & I like the adapted figure. That's a nice idea to attach platforms to it. I saw the paper on ERCCs and SRIVs. Haven't dug deep into it, but seems promising.

    ReplyDelete
  5. REUNITE YOUR MARRIAGE, RELATIONSHIP,SUCCESSFUL LOTTERY SPELL RESULTS, CURE ALL KINDS OF DISEASE AND WEAK ERECTION

    Stop asking for another chance, stop questioning what you could have done differently, and – most importantly – stop second-guessing your own self-worth. Once you Come Back To My Spell is performed, the balance of desire will shift and your lover will be begging you to take him or her back. This Love Spell Could Work For You!Bring back the good times. Think about the happiest time in your relationship, and i can make it happen again. You deserve to be happy.

    Are you looking for ultimate spells that works effectively same time on your problems, ranges from Love spells, marriage spells, and carrier related problems, witchcraft spells, charms, portion, talismans, magical oils / powders, protection, legal court cases, business prosperity spell, Gay and lesbian extreme love / attraction spells, women of the night Norton accruing powders and oil for extreme ecstasy and protection with in working ordeals.

    My powerful lottery spells, will bring you the huge wins, and jackpots you desire and need. I work my lottery spells, to bring great luck. The power of my lottery spells, works on you, so there are no special numbers needed to play, or certain patterns. Just play one ticket on the lottery of your choice, and the powerful lottery spell will handle the rest. Whether you play Power-ball, Mega Millions, daily drawings or sweepstakes. I have a powerful lottery spell, to help you. Working with my spirit guides, to clear bad luck, and infuse you with good luck and positive energy energy. The power of my lottery spells, brings luck, and wins fast. Clearing paths with-in the universe, for money and great luck to reach you. These powerful spell castings, will be successful in bringing the lottery wins, to change your life.

    Email: POTENTIALSPELLTEMPLE@GMAIL.COM

    OR


    POTENTIALSPELLTEMPLE@YAHOO.COM

    ReplyDelete

Note: only a member of this blog may post a comment.