Graphical abstract
Keywords: Time-series, Multi-omics, Visualization, Data exploration, Temporal multi-omics, Longitudinal multi-omics
Abstract
Thanks to recent advances in sequencing and computational technologies, many researchers with biological and/or medical backgrounds are now producing multiple data sets with an embedded temporal dimension. Multi-modalities enable researchers to explore and investigate different biological and physico-chemical processes with various technologies. Motivated to explore multi-omics data and time-series multi-omics specifically, the exploration process has been hindered by the separation introduced by each omics-type. To effectively explore such temporal data sets, discover anomalies, find patterns, and better understand their intricacies, expertise in computer science and bioinformatics is required. Here we present MOVIS, a modular time-series multi-omics exploration tool with a user-friendly web interface that facilitates the data exploration of such data. It brings into equal participation each time-series omic-type for analysis and visualization. As of the time of writing, two time-series multi-omics data sets have been integrated and successfully reproduced. The resulting visualizations are task-specific, reproducible, and publication-ready. MOVIS is built on open-source software and is easily extendable to accommodate different analytical tasks. An online version of MOVIS is available under https://movis.mathematik.uni-marburg.de/ and on Docker Hub (https://hub.docker.com/r/aanzel/movis).
1. Introduction
High-throughput technologies allow us to generate large amounts of data that could be used for medical and biological research. Multi-omics data sets have been extensively used to provide new insight into certain diseases such as cardiovascular diseases [1], type 2 diabetes [2], cancer [3], and infectious diseases [4]. With the new technologies mentioned above and technical advances in computational power, data sampling could become more granular. Data sets taken at one point in time can now be easily extended by creating new data sets at other time points, providing a more detailed picture of the underlying biological phenomena. These types of time-series data sets are becoming more common and are often explored using machine learning methods [5]. Although the demand for integrative, analytical, and explorative tools for such data is high, only a handful exists, e.g., TIMEOR [6], PyIOmica [7], and Functional Heatmap [8]. Functional Heatmap was developed as a web-based tool for time-series transcriptomics data sets. Analysis results can be exported in textual format or visually thanks to data visualizations, yet only using heatmaps or parallel coordinate plots. TIMEOR was also developed as a web-based tool for defining regulated gene networks from gene-related time-series data sets using RNA-seq, and protein-DNA interaction (such as ChIP-seq [9] and CUT&RUN [10]) techniques. In contrast, PyIOmica was developed as a Python [11] library with the ability to work with different time-series omics data sets, like proteomics, metabolomics, etc. It also includes gene ontology (GO) and Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway enrichment analyses. PyIOmica currently represents the most complete solution for working with time-series multi-omics data sets. Still, as a library, it does not allow domain specialists like biologists and biophysicists to conduct an exploratory data analysis. Besides that, none of these tools allow a step-wise, easy-to-follow pipeline, providing both control and freedom to explore the data and discover irregularities or trends in the data. With the challenge of multi-modal and temporal data, the analysis of multiple omics should provide multiple aspects that vary in scope and detail. For example, a side-by-side view of the outcome of each analysis integrating the same time span is necessary. To overcome these limitations and reduce the separation between each omic-type data, we developed the Multi-Omics VISualization (MOVIS) tool. MOVIS is a web-based, modular tool that enables easy exploration of time-series multi-omics data sets in a side-by-side fashion. In turn, it enables both developers and domain specialists to formulate and test their hypotheses. While the modularity of the core components enables developers to separate and recombine low-level functionalities, it supports requests for additional functionalities or omics-specific tasks. By means of modularity and using open-source libraries, it can be easily extended to accommodate new use case scenarios. To our knowledge, MOVIS is the first freely available time-series multi-omics data exploration tool and a pipeline for creating publication-ready visualizations.
2. Approach
MOVIS consists of three distinct parts: (1) a graphical web interface, (2) a data analysis core, and (3) a visualization canvas. The interactive graphical web interface is built on the open-source framework Streamlit (https://streamlit.io/). The user interface (UI) allows the user to split the screen into multiple views. Each view corresponds to one of five omics (genomics, proteomics, transcriptomics, metabolomics, physico-chemical data) available to work with. This functionality is presented in Fig. 1. UI also consists of a side panel used for navigation and shows basic information about the tool. The whole workflow is divided into five well-defined parts: (1) the original data set presentation, (2) optional creation of a new data set, (3) optional data set filtering, (4) optional data clustering, and (5) data set visualization. Some steps of the workflow are shown in Fig. 2. The data analysis core is responsible for five sequential core steps: importing, sanitizing, filtering, analyzing, and visualizing all data sets. The core works with five different types of omics data. In the first core step, i.e., importing, genomics, and proteomics data sets can be provided as archived FASTA files (ZIP, TAR, etc.) or as precalculated tabular (CSV or TSV) files. For the genomics data, archived GFF, KO, and Depth-of-coverage files are also supported. The latter is available for transcriptomics as well. Metabolomics, transcriptomics, and physico-chemical data sets can be provided as tabular files. In the case of transcriptomics data, users can upload multiple tabular data sets. However, each data set must have the same set of columns with precisely the same names. MOVIS concatenates these data sets into one unified data set with one new feature (column) named Type. This column contains the names of all user-uploaded files. Multi-tabular functionality is provided to enable more accessible work with multiple biological and technical replicate files simultaneously, which is common when researching gene expression. The sanitizing step is dependant on the data set format provided to the core. For archived data sets, the sanitizing step consists of unpacking the archive, checking the validity of the file names, and correcting them if they do not adhere to the naming rules. We created these rules so that file names could hold standardized temporal information of each file. If a data set is of a tabular format, the sanitizing step consists of various data quality checks. In this case, temporal information must be included as a feature of the data set. The filtering step is present only for tabular data sets. It offers a way to filter a certain time-series period and remove one or more rows or columns from the data set. The data analysis step is the central and most intricate part of the data analysis core. It provides embedding and clustering functionalities, as well as creating a new physico-chemical data set for archived FASTA data sets. The visualization step is responsible for visualizing and additional filtering of the data sets. It also implements interactivity to the resulting visualizations in the form of a tooltip, brushing, and/or spanning and zooming. The visualization canvas provides a unified representational space for all created visualizations. It enables users to export the created visualization in several formats. Each visualization can be exported as a PNG or SVG file or a Vega-Lite [12] source specification. This functionality is presented in Fig. 3. Currently, MOVIS supports nine different visualizations of time-series data sets: Correlation heatmap, Time heatmap, Multiple features parallel chart, Scatter-plot matrix, Scatter plot, Two features plot, Feature through time, Whisker plot, and Top 10 share through time. The user could use each of the visualizations for any data set type without any restrictions. However, some basic data knowledge is advised in order to choose appropriate visualizations for certain data set types. The visualization canvas, along with multiple visualizations, is shown in Fig. 4.
3. Methods
MOVIS is built using Python and additional libraries like Pandas [13], Numpy [14], Scikit-learn [15], Biopython [16], Gensim [17], Altair [18], and Streamlit. Tabular data sets (CSV or TSV) are internally imported as Pandas Data Frame structures. Archived data sets are first unpacked and then cleaned up using built-in Python libraries. If a FASTA data set is selected for proteomics or genomics, the web interface provides an option to calculate an additional physico-chemical data set. These properties are calculated with task-specific in–house algorithms by importing each FASTA sequence, one by one using Biopython, and then processing them. As of the time of writing, the additional data set created out of genomics FASTA data set contains three physico-chemical features — Hydrogen Bond, Stacking Energy, and Solvation. If an option to create an additional physico-chemical data set is selected for the proteomics FASTA data set, the data set consists of 43 physico-chemical features, e.g., Molecular Weight, Isoelectric Point, Instability Index, etc. The newly created data set incorporates the temporal dimension of the source data and can also be visualized as is. We integrated various methodologies into MOVIS to solve the embedding tasks. One of the central algorithms is the Word2Vec algorithm [19], [20] used to embed archived FASTA files into 100-dimensional vectors. Such embedding supports nucleotide- and amino-acid-based sequences. The dimension of the output vector was chosen empirically. Because each FASTA file may contain multiple sequences, we first embedded each sequence in a 100-dimensional vector and then averaged them to create one vector representing the FASTA file containing those sequences. This process results in a tabular data set containing the same number of rows as FASTA files in an archived dataset and 101 columns. Each column contains the temporal data, and the other 100 include the 100-dimensional vector embedding. The clustering step is presented with two clustering algorithms as options: KMeans [21] (distance-based) and OPTICS [22] (density-based). By having two different methods that achieve the same goal, different types of inductive principles are covered. The visualizations are created according to the nested model of visualization [23] and follow good data visualization practices [24]. That is to say, design considerations are taken to accommodate color blind users and enhance the accessibility of the visualizations to a broader audience. Other available data visualizations are reported in the supplementary material. Three different dimensionality reduction techniques are included to visualize clusters, namely PCA [25], [26], MDS [27], and t-SNE [28]. Although each of these methods aims to reduce the dimensionality of the data, their goal is different. Therefore, more choices provide a greater opportunity to distinguish patterns and anomalies in the data. The effect of choosing different dimensionality reduction techniques to visualize clusters of the same data set can be seen in Fig. 3. In this Figure, PCA was used for the upper, and MDS for the lower visualization.
4. Results
To demonstrate the usability of MOVIS, we present a case study based on one of the available examples. The case study is also built-in into MOVIS as one of the options on the navigation sidebar. As presented in MOVIS, the case study overview can be seen in Fig. 5, Fig. 6.
4.1. Case study — Introduction
We focused on the built-in Example 1 [29] (named as in MOVIS) that contains metagenomics, metaproteomics, metatranscriptomics, metabolomics, and physico-chemical data from the Biological WasteWater Treatment Plant (BWWTP). The data was collected in situ, at weekly intervals, and over 14 months. The end goal of this case study was to reveal if there were any niche types, and if there were, how did they respond to the substrate changes. To limit the scope of this use case, we proposed only using the functional aspects of the metabolomics data [29].
4.2. Case study — Main findings
Even though BWWTP operation is a controlled process, factors such as aeration cycles, seasonal changes in temperature, and composition of inflow wastewater fluctuate [30]. The physico-chemical factors may have a meaningful impact on population dynamics and linked process efficiency [31]. Therefore, the first step of our case study was to inspect relevant physico-chemical properties of the wastewater and determine major shifts, if any.
4.2.1. Physico-Chemical data
To demonstrate the function and utility of MOVIS, we selected the Physico-Chemical data and, more specifically, the Processed data set 1. The selected data set contains 34 different physico-chemical properties with a 2-h sampling rate. The properties of interest for this case study are Volume_aeration m3/h, T C (Temperature in Celsius), and Inflow_conductivity S/cm. We visualized the properties of interest using MOVIS in Fig. 7, Fig. 7, Fig. 7, respectively. We chose Feature through time visualization to accomplish this. Even with a lot of noise present, Fig. 7a showed the shape of a sine curve with three distinct local maxima (around June 2011, November 2011, and April 2012) and two distinct local minima (around August 2011 and January 2012). Fig. 7, Fig. 7c had less noise, with the latter figure showing a distinct increase in temperature near the end of the sampling period. In order to further examine the irregular behavior of temperature and conductivity, we visualized them using Time Heatmap in addition to the existing chart types. The new visualizations are presented in Fig. 8, Fig. 8, respectively. Provided with more granularity, we were able to see a detailed picture of each property. Fig. 8a showed a steady increase in temperature that peaks in September of 2011 and then slightly decreases until the start of December 2011. Then, we have a rapid decrease in temperature that lasts until March 2012 followed by a rapid increase that peaks in the beginning of April 2012 with temperatures going as high as 29.62 C. We efficiently inspected values by using the interactive tooltip feature. It appears upon the mouse hovering over the cells of interest. On the other hand, Fig. 8b showed high but steady values from the beginning of sampling and up until the last week of August 2011. After that, we found a swift decrease and stabilization of values that continues throughout the time series.
4.2.2. Metaproteomics data
Integrated meta-omics approaches hold the potential to resolve niches of microbial populations in situ [29]. Therefore, we shifted our focus to metaproteomics data to identify microbial clusters, if there were any, using only raw FASTA data. To ascertain the presence of microbial clusters, we selected Metaproteomics data, and then Raw FASTA files. When MOVIS completed embedding FASTA files, we selected the K-Means clustering method and using the Elbow rule chart we selected three as a number of clusters (centroids) for our clustering method. Then we inspected the evaluation window of the selected clustering method. With a silhouette score [32] of 0.495, we acknowledged that our method was successful, which was further corroborated by other available evaluation scores (e.g., The Davies-Bouldin index (DBI) [33], and The Calinski-Harabasz (CH) score [34]). Then we chose to visualize our data using two different dimensionality reduction techniques in order to determine which one gives a better visual outcome. The selection of PCA visualization and MDS visualization resulted in Fig. 9, Fig. 9, respectively. Both figures provided us with a visual way to evaluate chosen clustering method. As can be seen on both Fig. 9, Fig. 9, their upper-left corner showed a mixture of class-0 (circles) and class-2 (triangles), which indicated that K-Means had problems with clustering data embeddings that occupy that space. However, the clustering was successful since most data embeddings were placed in cloud points that have been determined to be in proximity and define a cluster. Inspecting the color gradient of the visualization marks allowed us to discover even more — samples clustered in the class-1 (rectangles) came in majority from the later time of the sampling period. The same could also be said for the class-2 samples, while class-0 samples came from a more dispersed sampling period. Mouse-hovering over each sample allowed us to determine the exact time that sample was collected. MOVIS also supports calculating amino-acid based physico-chemical properties of the metaproteomics data set, which could uncover an even more detailed picture of the underlying phenomena. For the sake of brevity, we did not select that option.
4.2.3. Metabolomics data
Since a significant shift in substrates of the influent wastewater sludge can alter the community composition [35], we moved our focus to the Metabolomics data set, and more specifically the Processed data set 2. The selected data set is of composite nature, which means that it contains multi-omic information. Almost of the data set represents metabolomics data, and the rest is physico-chemical data. Pre-combining omics data in such a fashion allows MOVIS to tap into the integrative aspect of the multi-omics nature. That aspect is planned but not yet directly available in MOVIS. Next, we selected Time heatmap visualization and chose feature named value as a quantitative color feature, param as a y-axis feature, and Diverging for the color scheme. Our selection resulted in Fig. 10. Further inspection of Fig. 10 revealed substrate shift happening from early to mid-November 2011 and early to mid-December 2011, with noticeably higher values in between. The substrate shift was defined by higher values of mainly non-polar metabolites, as well as polar metabolites, among which are putrescine and various disaccharides. After the end of December 2011, substrate levels normalized, and the community transitioned back to the pre-disturbance state.
4.2.4. Metagenomics data
One way of estimating population abundance is by using metagenomic depth-of-coverage. Since MOVIS is not explicitly designed to work with meta-omics data, no taxa linking is currently enabled. However, by inspecting average depth-of-coverage values, we could get some insights into the overall population dynamics over time. Therefore, we selected Metagenomics data, and then Depth-of-coverage, which presented us with a directory hierarchy of the underlying data set. After MOVIS automatically calculated important statistical values of the data set in use, we visualized results using Whisker plot. The visualization mentioned earlier can be seen in Fig. 11. The third quartile (Q3) and upper limits form the shape of a sine curve with a period of around one month and a slight discrepancy around the beginning of November 2011. The discrepancy is caused by the increase of outliers (not shown in Fig. 11) while calculating statistical values. We then visualized Mean depth-of-coverage values using Feature through time visualization. However, that did not provide us with any new insight.
4.3. Case study — Conclusion
The simultaneous exploration of multi-metaomics data sets using MOVIS allowed us to uncover temporal patterns and discrepancies of one metaomic data set and efficiently connect them with other metaomic data sets. Furthermore, a swift visualization of sizable time-series multi-modal data sets revealed significant microbial clusters and temporal points of interest. Withal, we are now empowered further to analyze temporal points of interest with metaomic-specific tools and uncover metaomic-specific details.
5. Discussion
First and foremost, MOVIS is the only time-series omics data exploration tool that is able to generate publication-ready visualizations of the underlying data by following best practices for user interface and data visualization design. Second, since it was written in a procedural way, it allows quick extensions with minor modifications. For example, the adoption of a new omic-type data requires the addition of one high-level function to the data analysis core. Third, the data analysis core presupposes that the data is preprocessed, that is to say, quality controlled and filtered. While FASTA files may be directly used as input, specific data such as raw microarray-based data cannot be used directly as input. The complexity of each omics domain knowledge makes this a challenging problem. Fourth, to support data exploration and visual analytic tasks, we rely on direct data interaction for tabular data. This interactivity lays the foundation for solving visual analytic tasks [36]. Fifth, clear and concise data analysis guidelines benefit multi-omics time-series analyses. Indeed, further omics-wide guidelines, time-series-specific, and data-specific standards are required. Sixth and last, we plan to integrate and make available many more data sets, omic-types data, clustering algorithms, dimensionality reduction methods, and visualizations. Moreover, the implementation of many other embedding algorithms should provide users with ample choice to accommodate the varying nature of the underlying imported data. In this line of reasoning, we are open to requests to include more data in the tool. Currently, two sample data sets are already integrated and available for exploration [29], [37]. Since the scope of the data and its size can have a significant impact on computational performance, we also plan to adapt MOVIS to cloud computing.
6. Conclusion
MOVIS is created as a modular and easy-to-use solution that includes state-of-the-art libraries and models to import, embed, cluster, and visualize temporal omics data. We expect that the proposed MOVIS will be a valuable tool to complement and enhance traditional data exploration approaches for temporal omics data and offer further insights into the patterns and anomalies of any of the five available omics types and their potential combination. MOVIS currently supports genomics, transcriptomics, metabolomics, proteomics, physico-chemical data, and metaomic aspects of aforementioned omic types.
Data availability
We provide MOVIS as a web service at https://movis.mathematik.uni-marburg.de/ and as a Docker container at https://hub.docker.com/r/aanzel/movis. The website version is free and open to all users, without any registration requirements. Source code, help, and documentation can be found at https://github.com/AAnzel/MOVIS. MOVIS is licensed under the GNU General Public License, Version 3.0, and can be manipulated, improved, and extended freely by any user.
Author contributions statement
A.A. wrote the manuscript, designed and developed the tool. D.H. discussed the results and revised the manuscript. G.H. supervised the project, guided the tool development, proofread, and revised the manuscript. All authors read and approved the final manuscript.
Funding
All authors are members of the MOSLA consortium, which has received funding from the Hessian Ministry for Science and the Arts (LOEWE).
Declaration of Competing Interest
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Acknowledgments
Specials thanks to Roman Martin for his support and expertise.
Footnotes
Supplementary data associated with this article can be found, in the online version, at https://doi.org/10.1016/j.csbj.2022.02.012.
Contributor Information
Aleksandar Anžel, Email: aleksandar.anzel@uni-marburg.de.
Dominik Heider, Email: dominik.heider@uni-marburg.de.
Georges Hattab, Email: georges.hattab@uni-marburg.de.
Supplementary data
The following are the Supplementary data to this article:
References
- 1.Leon-Mimila P., Wang J., Huertas-Vazquez A. Relevance of multi-omics studies in cardiovascular diseases. Front Cardiovascular Med. 2019;6:91. doi: 10.3389/fcvm.2019.00091. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Zhou W., Sailani M.R., Contrepois K., Zhou Y., Ahadi S., Leopold S.R., Zhang M.J., Rao V., Avina M., Mishra T., et al. Longitudinal multi-omics of host–microbe dynamics in prediabetes. Nature. 2019;569(7758):663–671. doi: 10.1038/s41586-019-1236-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Chaudhary K., Poirion O.B., Lu L., Garmire L.X. Deep learning–based multi-omics integration robustly predicts survival in liver cancer. Clinical Cancer Res. 2018;24(6):1248–1259. doi: 10.1158/1078-0432.CCR-17-0853. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Heider D., Dybowski J.N., Wilms C., Hoffmann D. A simple structure-based model for the prediction of hiv-1 co-receptor tropism. BioData Mining. 2014;7:14. doi: 10.1186/1756-0381-7-14. https://europepmc.org/articles/PMC4124776. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Nicora G., Vitali F., Dagliati A., Geifman N., Bellazzi R. Integrated multi-omics analyses in oncology: a review of machine learning methods and tools. Front Oncol. 2020;10:1030. doi: 10.3389/fonc.2020.01030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Conard A.M., Goodman N., Hu Y., Perrimon N., Singh R., Lawrence C., Larschan E. Timeor: a web-based tool to uncover temporal regulatory mechanisms from multi-omics data. Nucleic Acids Res. 2021;49(W1):W641–W653. doi: 10.1093/nar/gkab384. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Domanskyi S., Piermarocchi C., Mias G.I. Pyiomica: longitudinal omics analysis and trend identification. Bioinformatics. 2020;36(7):2306–2307. doi: 10.1093/bioinformatics/btz896. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Williams J.R., Yang R., Clifford J.L., Watson D., Campbell R., Getnet D., Kumar R., Hammamieh R., Jett M. Functional heatmap: an automated and interactive pattern recognition tool to integrate time with multi-omics assays. BMC Bioinform. 2019;20(1):1–6. doi: 10.1186/s12859-019-2657-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Johnson D.S., Mortazavi A., Myers R.M., Wold B. Genome-wide mapping of in vivo protein-dna interactions. Science. 2007;316(5830):1497–1502. doi: 10.1126/science.1141319. [DOI] [PubMed] [Google Scholar]
- 10.Skene P.J., Henikoff S. An efficient targeted nuclease strategy for high-resolution mapping of dna binding sites. Elife. 2017;6 doi: 10.7554/eLife.21856. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Van Rossum G., Drake F.L., Jr . Centrum voor Wiskunde en Informatica Amsterdam; The Netherlands: 1995. Python tutorial. [Google Scholar]
- 12.Satyanarayan A., Moritz D., Wongsuphasawat K., Heer J. Vega-lite: A grammar of interactive graphics. IEEE Trans Visualization & Comp Graphics (Proc InfoVis) 2017 doi: 10.1109/TVCG.2016.2599030. http://idl.cs.washington.edu/papers/vega-lite. [DOI] [PubMed] [Google Scholar]
- 13.McKinney Wes. In: Proceedings of the 9th Python in Science Conference. van der Walt Stéfan, Millman Jarrod., editors. 2010. Data Structures for Statistical Computing in Python; pp. 56–61. [DOI] [Google Scholar]
- 14.Harris C.R., Millman K.J., van der Walt S.J., Gommers R., Virtanen P., Cournapeau D., Wieser E., Taylor J., Berg S., Smith N.J., Kern R., Picus M., Hoyer S., van Kerkwijk M.H., Brett M., Haldane A., del Río J.F., Wiebe M., Peterson P., Gérard-Marchant P., Sheppard K., Reddy T., Weckesser W., Abbasi H., Gohlke C., Oliphant T.E. Array programming with NumPy. Nature. 2020;585(7825):357–362. doi: 10.1038/s41586-020-2649-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Pedregosa F., Varoquaux G., Gramfort A., Michel V., Thirion B., Grisel O., Blondel M., Prettenhofer P., Weiss R., Dubourg V., Vanderplas J., Passos A., Cournapeau D., Brucher M., Perrot M., Duchesnay E. Scikit-learn: Machine learning in Python. J Mach Learn Rese. 2011;12:2825–2830. [Google Scholar]
- 16.P.J.A. Cock, T. Antao, J.T. Chang, B.A. Chapman, C.J. Cox, A. Dalke, I. Friedberg, T. Hamelryck, F. Kauff, B. Wilczynski, M.J.L. de Hoon, Biopython: freely available Python tools for computational molecular biology and bioinformatics, Bioinformatics 25 (11) (2009) 1422–1423. arXiv:https://academic.oup.com/bioinformatics/article-pdf/25/11/1422/944180/btp163.pdf, doi:10.1093/bioinformatics/btp163. doi: 10.1093/bioinformatics/btp163. [DOI] [PMC free article] [PubMed]
- 17.R. Řehxŭřek, P. Sojka, Software Framework for Topic Modelling with Large Corpora, in: Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks, ELRA, Valletta, Malta, 2010, pp. 45–50.
- 18.VanderPlas J., Granger B., Heer J., Moritz D., Wongsuphasawat K., Satyanarayan A., Lees E., Timofeev I., Welsh B., Sievert S. Altair: Interactive statistical visualizations for python. J Open Source Softw. 2018 doi: 10.21105/joss.01057. [DOI] [Google Scholar]
- 19.T. Mikolov, I. Sutskever, K. Chen, G. Corrado, J. Dean, Distributed representations of words and phrases and their compositionality (2013). arXiv:1310.4546.
- 20.T. Mikolov, K. Chen, G. Corrado, J. Dean, Efficient estimation of word representations in vector space (2013). arXiv:1301.3781.
- 21.Arthur D., Vassilvitskii S. Society for Industrial and Applied Mathematics. Philadelphia, PA, USA; 2007. k-means++: the advantages of careful seeding, in: SODA ’07: Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms; pp. 1027–1035. [Google Scholar]
- 22.Ankerst M., Breunig M.M., Kriegel H.-P., Sander J. Proceedings of the 1999 ACM SIGMOD International Conference on Management of Data, SIGMOD ’99. Association for Computing Machinery; New York, NY, USA: 1999. Optics: Ordering points to identify the clustering structure; pp. 49–60. [DOI] [Google Scholar]
- 23.Munzner T. A nested model for visualization design and validation. IEEE Trans Visualization Computer Graphics. 2009;15(6):921–928. doi: 10.1109/TVCG.2009.111. [DOI] [PubMed] [Google Scholar]
- 24.Hattab G., Rhyne T.-M., Heider D. Ten simple rules to colorize biological data visualization. PLOS Comput Biol. 2020;16(10):1–18. doi: 10.1371/journal.pcbi.1008259. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Tipping M.E., Bishop C.M. Mixtures of probabilistic principal component analyzers. Neural Computation. 1999;11(2):443–482. doi: 10.1162/089976699300016728. [DOI] [PubMed] [Google Scholar]
- 26.Minka T.P. Automatic choice of dimensionality for pca. NIPS. 2000;13:514. [Google Scholar]
- 27.Borg I. Springer; New York: 2005. Modern multidimensional scaling: theory and applications. [Google Scholar]
- 28.van der Maaten L., Hinton G. Visualizing data using t-sne. J Mach Learn Res. 2008;9(86):2579–2605. http://jmlr.org/papers/v9/vandermaaten08a.html. [Google Scholar]
- 29.Herold M., Arbas S.M., Narayanasamy S., Sheik A.R., Kleine-Borgmann L.A.K., Lebrun L.A., Kunath B.J., Roume H., Bessarab I., Williams R.B.H., Gillece J.D., Schupp J.M., Keim P.S., Jäger C., Hoopmann M.R., Moritz R.L., Ye Y., Li S., Tang H., Heintz-Buschart A., May P., Muller E.E.L., Laczny C.C., Wilmes P. Integration of time-series meta-omics data reveals how microbial ecosystems respond to disturbance, Nature. Communications. 2020;11(1) doi: 10.1038/s41467-020-19006-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.D.R. Johnson, T.K. Lee, J. Park, K. Fenner, D.E. Helbling, The functional and taxonomic richness of wastewater treatment plant microbial communities are associated with each other and with ambient nitrogen and carbon availability, Environmental Microbiology 17 (12) (2015) 4851–4860. arXiv:https://sfamjournals.onlinelibrary.wiley.com/doi/pdf/10.1111/1462-2920.12429, doi:https://doi.org/10.1111/1462-2920.12429. https://sfamjournals.onlinelibrary.wiley.com/doi/abs/10.1111/1462-2920.12429 [DOI] [PubMed]
- 31.Xu S., Yao J., Ainiwaer M., Hong Y., Zhang Y. Analysis of bacterial community structure of activated sludge from wastewater treatment plants in winter. BioMed Res Int. 2018;2018 doi: 10.1155/2018/8278970. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rousseeuw P.J. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J Comput Appl Math. 1987;20:53–65. doi: 10.1016/0377-0427(87)90125-7. https://www.sciencedirect.com/science/article/pii/0377042787901257. [DOI] [Google Scholar]
- 33.D.L. Davies, D.W. Bouldin, A cluster separation measure, IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-1 (2) (1979) 224–227. doi:10.1109/TPAMI.1979.4766909. [PubMed]
- 34.T. Caliński, J. Harabasz, A dendrite method for cluster analysis, Communications in Statistics 3 (1) (1974) 1–27. arXiv:https://www.tandfonline.com/doi/pdf/10.1080/03610927408827101, doi:10.1080/03610927408827101. https://www.tandfonline.com/doi/abs/10.1080/03610927408827101.
- 35.Liu T., Liu S., Zheng M., Chen Q., Ni J. Performance assessment of full-scale wastewater treatment plants based on seasonal variability of microbial communities via high-throughput sequencing. PLOS ONE. 2016;11(4):1–15. doi: 10.1371/journal.pone.0152998. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.L. Bartram, M. Correll, M. Tory, Untidy data: The unreasonable effectiveness of Table (2021). arXiv:2106.15005. [DOI] [PubMed]
- 37.B.M.P. Pereira, X. Wang, I. Tagkopoulos, M. Kivisaar, Short- and long-term transcriptomic responses of escherichia coli to biocides: a systems analysis, Applied and Environmental Microbiology 86 (14) (2020) e00708–20. arXiv:https://journals.asm.org/doi/pdf/10.1128/AEM.00708-20, doi:10.1128/AEM.00708-20. https://journals.asm.org/doi/abs/10.1128/AEM.00708-20. [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
We provide MOVIS as a web service at https://movis.mathematik.uni-marburg.de/ and as a Docker container at https://hub.docker.com/r/aanzel/movis. The website version is free and open to all users, without any registration requirements. Source code, help, and documentation can be found at https://github.com/AAnzel/MOVIS. MOVIS is licensed under the GNU General Public License, Version 3.0, and can be manipulated, improved, and extended freely by any user.