Skip to main content

PROTOCOLS article

Front. Mol. Biosci., 04 June 2018
Sec. Structural Biology
This article is part of the Research Topic Technical Advances in Cryo-Electron Microscopy View all 6 articles

Benchmarking cryo-EM Single Particle Analysis Workflow

\r\nLaura Y. KimLaura Y. KimWilliam J. RiceWilliam J. RiceEdward T. EngEdward T. EngMykhailo KopylovMykhailo KopylovAnchi ChengAnchi ChengAshleigh M. RaczkowskiAshleigh M. RaczkowskiKelsey D. JordanKelsey D. JordanDaija BobeDaija BobeClinton S. Potter*Clinton S. Potter*Bridget Carragher*Bridget Carragher*
  • Simons Electron Microscopy Center, New York Structural Biology Center, New York, NY, United States

Cryo electron microscopy facilities running multiple instruments and serving users with varying skill levels need a robust and reliable method for benchmarking both the hardware and software components of their single particle analysis workflow. The workflow is complex, with many bottlenecks existing at the specimen preparation, data collection and image analysis steps; the samples and grid preparation can be of unpredictable quality, there are many different protocols for microscope and camera settings, and there is a myriad of software programs for analysis that can depend on dozens of settings chosen by the user. For this reason, we believe it is important to benchmark the entire workflow, using a standard sample and standard operating procedures, on a regular basis. This provides confidence that all aspects of the pipeline are capable of producing maps to high resolution. Here we describe benchmarking procedures using a test sample, rabbit muscle aldolase.

Introduction

At the Simons Electron Microscopy Center (SEMC) at the New York Structural Biology Center (NYSBC) in New York, NY, our mission is to provide scientific expertise and resources for our users in their studies of biological macromolecules, with a focus on high-resolution structure determination. Our facility is home to seven electron microscopes (EMs), including three 300 kV FEI Titan Krios instruments, all of which are routinely checked for their performance using a series of benchmarking tests. While these checks include standard testing for performance and resolution, typically using a cross grating replica, we believe it is also important to test our systems using a biological sample that scrutinizes the entire workflow from specimen preparation through imaging and image processing. This benchmarking enables us not only to assess any limitations and bottlenecks that might arise, but also allows us to optimize the single particle analysis (SPA) workflow, thus maximizing the throughput and performance of instrumentation and data collection strategies. In addition to the practical advantages of benchmarking, the overall workflow serves as an educational tool for newcomers to cryo electron microscopy (cryo-EM) who wish to learn the SPA workflow using a protein that can be routinely reconstructed to high resolution. Finally, benchmarking tests provide an objective measure to the user that the instrumentation is operating at its top optical efficiency, capable of providing good quality structures, and that any limitations to resolution are thus most likely related to an individual sample.

Benchmarking efforts for SPA are not straightforward for EM labs. This challenge is due in part to the lack of an “industry standard” biological EM specimen and also due to intrinsic variabilities that exist at the specimen purification and grid preparation level. This variability is then coupled with a wide range of data collection and image processing strategies and software choices. An ideal cryo-EM benchmarking standard would be a biological specimen with the following attributes: (1) easily accessible (i.e., commercially available and requiring minimal additional purification), (2) low maintenance sample preparation, (3) biochemically stable over a range of temperatures and time periods, (4) little to no conformational and compositional heterogeneity.

It is also important that the benchmark results in a structure with a sufficiently high resolution, which we consider to be below 3 Å, in order to give confidence in users as to the performance of the instrument, the data collection protocols and the processing pipeline. There are currently 36 unique structures in the EMDataBank at a sub 3 Å resolution that have been obtained by SPA. These include the 465 kD beta-galactosidase at 2.2 Å resolution (Bartesaghi et al., 2015), the 540 kD p97 at 2.3 Å (Banerjee et al., 2016),the 334 kD glutamate dehydrogenase at 1.8 Å (Merk et al., 2016) and the 150 kD aldolase at 2.6 Å (Herzik et al., 2017) as well as larger proteins that have been used as standards in cryo-EM SPA, like the 700 kDa Thermoplasma acidophilum 20 S proteasome (Li et al., 2013; Campbell et al., 2014, 2015; Danev and Baumeister, 2016; Danev et al., 2017) and 440 kDa apoferritin (Russo and Passmore, 2014; Arnold et al., 2017; Rickgauer et al., 2017).

In this paper, we present a workflow for single particle reconstruction using a robust and reliable benchmarking standard: rabbit muscle aldolase, a small homotetrameric glycolytic enzyme with a molecular weight of ~150 kDa. Our goal is to present this benchmarking procedure as a step-by-step workflow that can be readily repeated. We show that in order to achieve a sub 3 Å reconstruction of aldolase in a reasonable time frame, ice thickness of 10–20 nm is essential.

Methods and Materials

Sample Preparation

The sample was prepared as previously described with minor adjustments (Herzik et al., 2017). Briefly, pure aldolase isolated from rabbit muscle (Sigma Aldrich, product #A2714) was solubilized in 20 mM HEPES (pH 7.5), 50 mM NaCl at 3 mg/ml and further purified using a Superose 6 10/300 GL (GE Healthcare) column equilibrated in solubilization buffer. SDS-PAGE analysis was used to confirm sample purity of peak fractions, which were pooled and concentrated to 10 mg/mL and flash frozen in 10 μl aliquots for long term storage. The protein was diluted to 1.5 mg/ml final concentration for grid preparation. Vitrified specimens were prepared by adding 3 μl aldolase (1.5 mg/ml) to freshly plasma cleaned (Gatan Solarus plasma cleaner, 75% argon/25% oxygen atmosphere at 15 Watts for 6 s) Au R1.2/1.3 300-mesh (EMS UltrAuFoil®) grids. To minimize the effects of beam induced motion during acquisition, samples were prepared on gold grids (Russo and Passmore, 2014). Grids were blotted for 1 s after a 10 s pre-blotting time, then plunge-frozen in liquid ethane using a Leica EM GP instrument (Leica Microsystems), with the chamber maintained at 4°C and 90% humidity.

Microscope Alignment

Complete microscope alignment procedures, based on the FEI on-line manual, were performed during installation using a cross-grating calibration grid (Titan on-line help manual—Alignments, version 2.6 and higher). A minimal subset of the alignments is performed before each daily data collection. These include dark and bright gain corrections and energy filter alignment, performed over vacuum, and beam tilt pivot points and Cs (spherical aberration coefficient) correction, performed at eucentric height and eucentric focus over carbon. Second-order axial coma free alignment and astigmatism minimization was done using the Cs corrector, aligning until A1 (2-fold astigmatism) was <10 nm and B2 (coma) was <50 nm. Re-tuning of the Cs corrector was performed if the CTF estimation indicated a differential between the major and minor axis of >100 nm. A full tune of the energy filter was carried out daily and energy filter slit was realigned every 60 min, managed automatically by Leginon (Suloway et al., 2005). The image distortion after tuning is typically within 0.2%, and the slit movement was generally ±1 eV. The goal of these alignments is to verify the presence of Thon rings visible beyond 3 Å resolution in the power spectrum of aligned images collected over amorphous carbon using the same imaging conditions as for the data collection. The eucentric height and eucentric focus are set using Leginon (Suloway et al., 2005) by minimizing movement caused by stage tilt. The beam intensity was kept well within the parallel range of the 3-condenser lens Titan system, with the illuminated beam diameter at least 2–3 times larger than the minimum required for parallel illumination. At a nominal magnification of 130,000x the calibrated beam diameter for parallel illumination is 0.45–12.0 μm. In general, the beam diameter was set to be slightly larger than the nominal hole size of 1.2 μm. This helps to ensure that the beam will contact the gold substrate during exposure collection, potentially helping to dissipate charge onto the substrate instead of the sample. Dose rate measurements on the Gatan K2 Summit direct electron detector (DED) were collected to determine whether or not changes to spot size were necessary to achieve the desired dose rate. All high magnification imaging was done in the nanoprobe mode with a 70 μm C2 aperture and a 100 μm objective aperture.

Data Collection

Table 1 summarizes the data collection statistics for three different datasets, 17sep21j, 17nov02c, and 17dec27a. Briefly, data was acquired using a Titan Krios with a spherical aberration corrector and a post-column Gatan Image Filter (GIF) operating in nanoprobe and EF-TEM mode with an extraction voltage of 4,250 V, a gun lens setting of 4, a spot size of 6 or 7, a C2 aperture size of 70 μm, an objective aperture size of 100 μm, and an energy filter slit width of 20 eV. The microscope is equipped with a field emission gun operating in the X-FEG module. Data was collected automatically using the MSI-T2 application in Leginon and all image pre-processing was performed using the Appion pipeline (Lander et al., 2009). Square and sub-square level images were targeted by stage position movement, with a 2 and 5 s pause before imaging, respectively. Drift monitor cutoff was 6 Å/s. Focusing was performed on the gold substrate, after which four final high-magnification movies were acquired by image shift targeting with a 5 s pause before the first image and 2.5 s pause before each subsequent movie. Final high-magnification movies were taken at a nominal magnification of 130,000x (calibrated pixel size of 0.855 Å at the detector level) and a nominal defocus range of −1.0 to −2.0 μm defocus with the Gatan K2 Summit DED operating in either counting or super-resolution mode. Each movie was acquired over 6,000–6,600 ms with a frame rate of 5 frames/s and a dose rate of 8 electrons/pixel/s. The total cumulative dose for all datasets was in the range of 60–70 electrons/Å2.

TABLE 1
www.frontiersin.org

Table 1. Data collection statistics.

In addition to our standard data collection workflow, we routinely collect ice thickness measurements for each high magnification movie. This is done by comparing the intensities of images taken without and with the energy filter slit inserted (Rice et al., in review; Figures 1D,H,L).

FIGURE 1
www.frontiersin.org

Figure 1. Comparing images from thick vs. thin ice. Exemplary images from (A) 17sep21j (#1), (E) 17nov02c (#2), and (I) 17dec27a (#3) datasets. Quantitative metrics such as the estimation of resolution from CTFFindV4 (B,F,J) and qualitative metrics such as the presence/absence of the water diffraction ring around the 3 Å mark (C,G,K), and ice thickness measurements of the micrographs (D,H,L), should be monitored during data collection. A CTFFindV4 resolution estimation worse than 4 Å and the presence of a strong water diffraction ring are both indicative of thick ice, and areas like this should be avoided. All images were acquired with ~1.5 mm defocus. Ice thickness measurements provide a useful metric for data quality (D,H,L). Datasets 17sep21j and 17dec27a both contain a majority of images where ice thickness is in the range 0–20 nm. The majority of 17nov02c images have thickness in the range 0–10 nm (ice that is too thin or completely absent) or very thick ice in the range 100–250 nm. The dimensions of aldolase are ~100 Å so this thick ice is more than 20 times more than the longest dimension of the particle.

Concurrent Image Processing

During data collection, images were pre-processed to provide a feedback on image quality. All pre-processing was carried out using the Appion pipeline (Lander et al., 2009). Mechanical and beam-induced motion correction and dose weighting were performed on the raw movies using MotionCor2 (Zheng et al., 2017) using a 5 × 5 patch size and a B-factor of 100 with 7 iterations. Super-resolution movies were binned by two before frame summation. Whole-image contrast transfer function (CTF) estimation was performed using CTFFind4 (Rohou and Grigorieff, 2015). Particle picking was performed within Appion using FindEM template picking (Roseman, 2004) with templates generated from images of the same sample acquired on a screening microscope. Box files from the particle picks were generated within Appion and exported for further processing. Subsets were exported for processing during collection and the final full datasets were then processed post-collection.

Post Collection Image Processing

Reference-free 2D classification was performed using cryoSPARC (Punjani et al., 2017) on particles binned by 4 with a box size of 256 pixels. Particles exhibiting secondary structure elements were selected for further processing, including initial model generation, and subsequent 3D classification and 3D auto-refinement using both RELION 2.0 (Kimanius et al., 2016) and cryoSPARC (Punjani et al., 2017). Default processing parameters were generally used. All reported resolutions are based on the 0.143 Fourier shell criterion (Henderson et al., 2012; Scheres and Chen, 2012) with all Fourier shell correlation (FSC) curves corrected for the effects of soft- masking by high-resolution noise substitution (Chen et al., 2013). Data processing statistics, including number of particles and average processing times, are described in Table 2.

TABLE 2
www.frontiersin.org

Table 2. Processing and reconstruction statistics.

Figure 1 shows exemplary images from the datasets #1, #2, and #3. Figure 2 shows processing results from dataset #1 and #2, including 2D class averages, Euler plots, FSC curves, 3D maps, and ice thickness plots.

FIGURE 2
www.frontiersin.org

Figure 2. Comparing 3D reconstructions from thick vs. thin ice 2D and 3D processing results from 17sep21j (dataset #1) and 17nov02c (dataset #2) which yielded maps at 2.5 and 3.0 Å resolution, respectively. Dataset #1 has thinner ice in the raw micrographs, ranging from 10 to 20 nm thick, whereas dataset #2 has thicker ice, ranging from 100 to 250 nm thick. Data to assess include raw micrographs (A,G), 2D classifications (B,J), FSC plots (C,H), sphericity plots (D,I), 3D maps (E,K), and local resolution maps (F,L). Both datasets have about 200,000 particles contributing to the final refinement but dataset #1 is both qualitatively and quantitatively better than dataset #2.

Results and Discussion

We describe three separate data sets that were processed based on three different sorting criteria: the first few hundred images collected for the session, all images collected in the session, images sorted by ice thickness <25 nm, for a total of nine experiments (Table 2). The details of data acquisition and processing are provided in Tables 1,2, respectively.

While all three data sets result in 3 Å or better maps, the major variable in terms of data and map quality was ice thickness. For grids with very thin ice, sub 3 Å maps can be obtained in a much shorter time period and with fewer images than from grids with much larger ice thickness. Use of image shift navigation as opposed to stage position navigation is our preferred mode of data collection as it helps to maximize acquisition throughput, and moderate amounts of image shift do not affect results at the targeted resolution (Cheng et al., in review).

From experience (and personal communication with the Lander lab) we have concluded that it is very important to maximize the number of particles packed into each hole, while avoiding particle overlap and aggregation. This close packing provides a more accurate CTF estimation of each image since the protein contributes a high signal to the power spectrum of the image. We also hypothesize that the densely packed protein is instrumental in achieving a very thin ice layer, as it may help to retain a thin layer of liquid across the hole. Dense packing of the protein is concentration dependent and can lead to multiple layers of particles (Noble et al., in review). This is refractory to high-resolution goals as two layers of protein result in a whole-image defocus estimation averaged between the two layers, thus limiting the resolution of each particle depending on their distance from the midway point.

Table 2 shows the results of processing the 17sep21j dataset (#1, #1a, and #1b) in three different ways including all 699 images (dataset #1), sorting based on including only images with <25 nm ice thickness (dataset #1a) and using only the first 500 images (dataset #1b). We found that resolution of 2.5 Å can be achieved either by using all images or by using only those from the thinnest ice. Micrographs coming from the thinnest ice yield a higher resolution final reconstruction and thus limiting image acquisition to areas of thin ice is clearly a more efficient strategy than brute force processing of the largest number of images. The 17sep21j dataset is near-perfect in that it can yield a sub 3 Å reconstruction in under 24 h, regardless of how the data is sorted because of the majority of images coming from a very thin ice.

The 17nov02c (#2, #2a, and #2b) dataset is representative of the type of data collection that should be avoided if possible. This dataset required a large block of microscope time (52 h), processing time and computational resources (over 1.3 M particles before 2D classification). While dataset #2 yielded a 3.0 Å map it required a total data collection and processing duration of ~60 h. Ideally, a benchmarking test should be accomplished in <24 h. Also, the sorted data from this dataset (#2a and #2b) both provided reconstructions worse than 3.0 Å, due to the very small number of particles that are in thin ice.

The 17dec27a (#3) dataset yielded a similarly high-resolution data as the 17sep21j (#1) dataset, but it required more than twice the length of microscope and processing time, 49 vs. 21 h. Both datasets contributed about 200 K particles to the final refinement, but 17dec27a (#3) started with more than twice the number of micrographs compared to 17sep21j (#1) (1,614 vs. 699 micrographs).

Table 3 ranks the datasets by nominal resolution. We find that all sub 3 Å reconstructions are derived from datasets with an ice thickness range of 10–20 nm, independent of how the data was sorted indicating that ice thickness is a primary driver of data quality for the SPA of aldolase. Quantitative metrics like ice thickness measurements, or qualitative metrics such as the presence of an ice ring in the power spectrum of the image should be used to guide data collection strategy during collection. The 17sep21j and 17dec27a datasets had ice thickness measurements on average around 10–20 nm, whereas the 17nov21j ranged from 100 to 250 nm. Rabbit muscle aldolase, a 150 kDa homotetramer, has unit cell dimensions of 82.8 × 100.6 × 84.5 Å, so that individual particles are readily visible in ice 10–25 nm thick, but once embedded in ice that is 100–250 nm thick, contrast is much worse and individual particles are difficult to identify. In addition to the loss of contrast in the images, once the ice thickness is nearly 10 times that of the longest length of the particle of interest, it is likely that multiple layers of particles are present in the image, adhering to either side of the exposed air-water interface (Noble et al., in review) which would also interfere with the possibility of getting a high resolution reconstruction.

TABLE 3
www.frontiersin.org

Table 3. Ranking of datasets based on data collection and processing time and resolution.

We conclude that the most important factor in reaching a sub 3 Å map in less than 24 h for our aldolase benchmark specimen is to have grids with ice thickness in the range of 10–20 nm. Use of a Cs-corrected system is not required for achieving these results as we have been able to replicate similar results using a well-aligned, non Cs-corrected systems. Similar results were achieved from the super-resolution and counting mode datasets, implying that it is not necessary to collect data in super-resolution mode to produce a sub 3 Å reconstruction. We also note that on-the-fly data processing, which includes frame alignment, CTF estimation, and particle picking, is critical to maximizing the quantity and quality of data collected. Real-time feedback of the data helps guide the data collection strategy, allowing the user to be more critical about which regions of a grid, square, and hole to collect in (based on information on particle density, distribution, ice thickness, etc.), how long to pause between images (based on the motion correction plots), and how much defocus to apply (depending on how much contrast is visible in the aligned movies).

In summary, we show that with a commercially available protein and minimal biochemical purification, it is possible to prepare grids for characterizing microscopes at high resolution. While our protocol was tested on a Titan Krios microscope equipped with a K2 detector, this protocol could easily be adapted to other workflows (e.g., EPU or SerialEM) and microscope/detector combinations. Having a set of standard samples used by many EM labs will be generally useful for the field.

Data Availability Statement

The cryo-EM maps of #1, 1a, 1b, 2, 2a, 2b, 3, 3a, 3b were deposited to the Electron Microscopy Data Bank (EMDB) with accession codes EMD-7616, EMD-7617, EMD-7614, EMD-7551, EMD-7562, EMD-7615, EMD-7541, EMD-7550, and EMD-7528, respectively. Raw data were made available at the Electron Microscopy Pilot Image Archive (EMPIAR) for the full datasets 1, 2, and 3 with accession code EMPIAR-10182, EMPIAR-10183, and EMPIAR-10184, respectively.

Author Contributions

LK performed sample preparation, microscope alignment, and data collection; wrote the manuscript. WR performed ice thickness measurements and analysis; edited the manuscript. EE performed data collection and image processing; edited the manuscript. MK performed microscope alignment and data collection; edited the manuscript. AC edited the manuscript. AR, KJ, and DB performed sample preparation and data collection. CP conceived and designed experiments; edited the manuscript. BC conceived and designed experiments; edited the manuscript.

Funding

All work was performed at the Simons Electron Microscopy Center and National Resource for Automated Molecular Microscopy located at the New York Structural Biology Center, supported by grants from the Simons Foundation (SF349247), NYSTAR, and the NIH National Institute of General Medical Sciences (GM103310) with additional support from Agouron Institute (F00316) and NIH (OD019994).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The authors wish to thank Dr. Gabriel Lander (Scripps Research Institute) for helpful insight and discussions.

References

Arnold, S. A., Albiez, S., Bieri, A., Syntychaki, A., Adaixo, R., McLeod, R. A., et al. (2017). Blotting-free and lossless cryo-electron microscopy grid preparation from nanoliter-sized protein samples and single-cell extracts. J. Struct. Biol. 197, 220–226. doi: 10.1016/j.jsb.2016.11.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Banerjee, S., Bartesaghi, A., Merk, A., Rao, P., Bulfer, S. L., Yan, Y., et al. (2016). 2.3 Å resolution cryo-EM structure of human p97 and mechanism of allosteric inhibition. Science 351, 871–875. doi: 10.1126/science.aad7974

PubMed Abstract | CrossRef Full Text | Google Scholar

Bartesaghi, A., Merk, A., Banerjee, S., Matthies, D., Wu, X., Milne, J. L., et al. (2015). 2.2 Å resolution cryo-EM structure of β-galactosidase in complex with a cell-permeant inhibitor. Science 348, 1147–1151. doi: 10.1126/science.aab1576

PubMed Abstract | CrossRef Full Text | Google Scholar

Campbell, M. G., Kearney, B. M., Cheng, A., Potter, C. S., Johnson, J. E., Carragher, B., et al. (2014). Near-atomic resolution reconstructions using a mid-range electron microscope operated at 200 kV. J. Struct. Biol. 188, 183–187. doi: 10.1016/j.jsb.2014.09.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Campbell, M. G., Veesler, D., Cheng, A., Potter, C. S., and Carragher, B. (2015). 2.8 Å resolution reconstruction of the Thermoplasma acidophilum 20S proteasome using cryo-electron microscopy. Elife 4:e06380. doi: 10.7554/eLife.06380

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, S., McMullan, G., Faruqi, A. R., Murshudov, G. N., Short, J. M., Scheres, S. H., et al. (2013). High-resolution noise substitution to measure overfitting and validate resolution in 3D structure determination by single particle electron cryomicroscopy. Ultramicroscopy 135:24–35. doi: 10.1016/j.ultramic.2013.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Danev, R., and Baumeister, W. (2016). Cryo-EM single particle analysis with the Volta phase plate. Elife 5:e13046. doi: 10.7554/eLife.13046

PubMed Abstract | CrossRef Full Text | Google Scholar

Danev, R., Tegunov, D., and Baumeister, W. (2017). Using the Volta phase plate with defocus for cryo-EM single particle analysis. Elife 6:e23006. doi: 10.7554/eLife.23006

PubMed Abstract | CrossRef Full Text | Google Scholar

Henderson, R., Sali, A., Baker, M. L., Carragher, B., Devkota, B., Downing, K. H., et al. (2012). Outcome of the first electron microscopy validation task force meeting. Structure 20, 205–214. doi: 10.1016/j.str.2011.12.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Herzik, M. A. Jr., Wu, M., and Lander, G. C. (2017). Achieving better-than-3- Å resolution by single-particle cryo-EM at 200 keV. Nat Methods 14, 1075–1078. doi: 10.1038/nmeth.4461

PubMed Abstract | CrossRef Full Text | Google Scholar

Kimanius, D., Forsberg, B. O., Scheres, S. H., and Lindahl, E. (2016). Accelerated cryo-EM structure determination with parallelisation using GPUs in RELION-2. Elife 5:e18722. doi: 10.7554/eLife.18722

PubMed Abstract | CrossRef Full Text | Google Scholar

Lander, G. C., Stagg, S. M., Voss, N. R., Cheng, A., Fellmann, D., Pulokas, J., et al. (2009). Appion: an integrated, database-driven pipeline to facilitate EM image processing. J. Struct. Biol. 166, 95–102. doi: 10.1016/j.jsb.2009.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Mooney, P., Zheng, S., Booth, C. R., Braunfeld, M. B., Gubbens, S., et al. (2013). Electron counting and beam-induced motion correction enable near-atomic-resolution single-particle cryo-EM. Nat. Methods 10, 584–590. doi: 10.1038/nmeth.2472

PubMed Abstract | CrossRef Full Text | Google Scholar

Merk, A., Bartesaghi, A., Banerjee, S., Falconieri, V., Rao, P., Davis, M. I., et al. (2016). Breaking Cryo-EM resolution barriers to facilitate drug discovery. Cell 165, 1698–1707. doi: 10.1016/j.cell.2016.05.040

PubMed Abstract | CrossRef Full Text | Google Scholar

Punjani, A., Rubinstein, J. L., Fleet, D. J., and Brubaker, M. A. (2017). cryoSPARC: algorithms for rapid unsupervised cryo-EM structure determination. Nat. Methods 14, 290–296. doi: 10.1038/nmeth.4169

PubMed Abstract | CrossRef Full Text | Google Scholar

Rickgauer, J. P., Grigorieff, N., and Denk, W. (2017). Single-protein detection in crowded molecular environments in cryo-EM images. Elife 6:e25648. doi: 10.7554/eLife.25648

PubMed Abstract | CrossRef Full Text | Google Scholar

Rohou, A., and Grigorieff, N. (2015). CTFFIND4: Fast and accurate defocus estimation from electron micrographs. J. Struct. Biol. 192, 216–221. doi: 10.1016/j.jsb.2015.08.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Roseman, A. M. (2004). FindEM–a fast, efficient program for automatic selection of particles from electron micrographs. J. Struct. Biol. 145, 91–99. doi: 10.1016/j.jsb.2003.11.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Russo, C. J., and Passmore, L. A. (2014). Electron microscopy: ultrastable gold substrates for electron cryomicroscopy. Science 346, 1377–1380. doi: 10.1126/science.1259530

PubMed Abstract | CrossRef Full Text | Google Scholar

Scheres, S. H., and Chen, S. (2012). Prevention of overfitting in cryo-EM structure determination. Nat. Methods 9, 853–854. doi: 10.1038/nmeth.2115

PubMed Abstract | CrossRef Full Text | Google Scholar

Suloway, C., Pulokas, J., Fellmann, D., Cheng, A., Guerra, F., Quispe, J., et al. (2005). Automated molecular microscopy: the new Leginon system. J. Struct. Biol. 151, 41–60. doi: 10.1016/j.jsb.2005.03.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Zheng, S. Q., Palovcak, E., Armache, J. P., Verba, K. A., Cheng, Y., and Agard, D. A. (2017). MotionCor2: anisotropic correction of beam-induced motion for improved cryo-electron microscopy. Nat. Methods 14, 331–332. doi: 10.1038/nmeth.4193

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: cryo-electron microscopy, benchmarking, alignment, structural biology, single particle workflow, resolution

Citation: Kim LY, Rice WJ, Eng ET, Kopylov M, Cheng A, Raczkowski AM, Jordan KD, Bobe D, Potter CS and Carragher B (2018) Benchmarking cryo-EM Single Particle Analysis Workflow. Front. Mol. Biosci. 5:50. doi: 10.3389/fmolb.2018.00050

Received: 07 March 2018; Accepted: 08 May 2018;
Published: 04 June 2018.

Edited by:

Marta Carroni, Science for Life Laboratory (SciLifeLab), Sweden

Reviewed by:

Daniel Kofi Clare, Diamond Light Source (United Kingdom), United Kingdom
Doriano Lamba, Consiglio Nazionale delle Ricerche (CNR), Italy

Copyright © 2018 Kim, Rice, Eng, Kopylov, Cheng, Raczkowski, Jordan, Bobe, Potter and Carragher. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Bridget Carragher, bcarr@nysbc.org
Clinton S. Potter, cpotter@nysbc.org

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.