diff --git a/changelog/multiqc/v0.1.mdx b/changelog/multiqc/v0.1.mdx new file mode 100644 index 000000000..68438b559 --- /dev/null +++ b/changelog/multiqc/v0.1.mdx @@ -0,0 +1,13 @@ +--- +title: MultiQC v0.1 +date: 2015-09-01 +tags: [multiqc] +--- + +The first public release of MultiQC, after a month of development. Basic structure in place and modules for FastQC, FastQ Screen, Cutadapt, Bismark, STAR, Bowtie, Subread featureCounts and Picard MarkDuplicates. Approaching stability, though still under fairly heavy development. + +Download `MultiQC.app.zip` for the Mac OS X graphical tool. To run from the command line, download the zip of the code. Can also be installed directly with `pip` from [PyPI](https://pypi.python.org/pypi/multiqc/0.1): + +``` +pip install multiqc +``` diff --git a/changelog/multiqc/v0.2.mdx b/changelog/multiqc/v0.2.mdx new file mode 100644 index 000000000..09a3a9ee2 --- /dev/null +++ b/changelog/multiqc/v0.2.mdx @@ -0,0 +1,13 @@ +--- +title: MultiQC v0.2 +date: 2015-09-18 +tags: [multiqc] +--- + +A major rewrite of MultiQC, with a lot of stabilisation and sanitisation. Many new functions created in Python and JavaScript to handle common functions, making writing new modules much easier. New toolbox of features created for report, making it much more interactive. + +Download `MultiQC_v0.2.app.zip` for the Mac OS X graphical tool. To run from the command line, download the zip of the code. Can also be installed directly with `pip` from [PyPI](https://pypi.python.org/pypi/multiqc/0.1): + +``` +pip install multiqc +``` diff --git a/changelog/multiqc/v0.3.1.mdx b/changelog/multiqc/v0.3.1.mdx new file mode 100644 index 000000000..d3c3931e1 --- /dev/null +++ b/changelog/multiqc/v0.3.1.mdx @@ -0,0 +1,13 @@ +--- +title: MultiQC v0.3.1 +date: 2015-11-04 +tags: [multiqc] +--- + +Hotfix to patch a bug that I found immediately after submitting v0.3.0 - sorry! Took the opportunity to add a few more new things to sweeten the deal. + +### Changelog +- Hotfix patch to fix broken FastQC module (wasn't finding `.zip` files properly) +- General Stats table colours now flat. Should improve browser speed. +- Empty rows now hidden if appear due to column removal in general stats +- FastQC Kmer plot removed until we have something better to show. diff --git a/changelog/multiqc/v0.3.2.mdx b/changelog/multiqc/v0.3.2.mdx new file mode 100644 index 000000000..bc73b6a0f --- /dev/null +++ b/changelog/multiqc/v0.3.2.mdx @@ -0,0 +1,54 @@ +--- +title: MultiQC v0.3.2 +date: 2016-02-08 +tags: [multiqc] +--- + +New version - a number of new modules, a few new command line options and some new toys in the report user interface. + +I've just noticed that this was a bugfix version number bump and it should have been a minor version bump (`v0.4`). But I've already pushed this to PyPI so I'm not going to change it now. Sorry. + +Anyway, here's what's new: + +## Changelog +- All modules now load their log file search parameters from a config + file, allowing you to overwrite them using your user config file + - This is useful if your analysis pipeline renames program outputs +- New Picard (sub)modules - Insert Size, GC Bias & HsMetrics +- New Qualimap (sub)module - RNA-Seq QC +- Made Picard MarkDups show percent by default instead of counts +- Added M-Bias plot to Bismark +- New option to stream report HTML to `stdout` +- Files can now be specified as well as directories +- New options to specify whether the parsed data directory should be created + - command line flags: `--data` / `--no-data` + - config option name: `make_data_dir` +- Fixed bug with incorrect path to installation dir config YAML file +- New toolbox drawer for bulk-exporting graph images +- Report side navigation can now be hidden to maximise horizontal space +- Mobile styling improved for narrow screen +- More vibrant colours in the general stats table +- General stats table numbers now left aligned +- Settings now saved and loaded to named localstorage locations + - Simplified interface - no longer global / single report saving + - Removed static file config. Solves JS error, no-one was doing this + since we have standalone reports anyway. +- Added support for Python 3.5 +- Fixed bug with module specific CSS / JS includes in some templates +- Made the 'ignore files' config use unix style file pattern matching +- Fixed some bugs in the FastQ Screen module +- Fixed some bugs in the FastQC module +- Fixed occasional general stats table bug +- Table sorting on sample names now works after renaming +- Bismark module restructure + - Each report type now handled independently (alignment / dedup / meth extraction) + - M-Bias plot now shows R1 and R2 +- FastQC GC content plot now has option for counts or percentages + - Allows comparison between samples with very different read counts +- Bugfix for reports javascript + - Caused by updated to remotely loaded HighCharts export script + - Export script now bundled with multiqc, so does not depend on internet connection + - Other JS errors fixed in this work +- Bugfix for older FastQC reports - handle old style sequence dup data +- Bugfix for varying Tophat alignment report formats +- Bugfix for Qualimap RNA Seq reports with paired end data diff --git a/changelog/multiqc/v0.3.mdx b/changelog/multiqc/v0.3.mdx new file mode 100644 index 000000000..27be9c0f5 --- /dev/null +++ b/changelog/multiqc/v0.3.mdx @@ -0,0 +1,41 @@ +--- +title: MultiQC v0.3 +date: 2015-11-04 +tags: [multiqc] +--- + +Lots of spit and polish added to MultiQC in this release - everything should now be properly documented and reports are quite a bit more stable. + +### Changelog +- Lots of lovely new documentation! +- Child templates - easily customise specific parts of the default report template +- Plugin hooks - allow other tools to execute custom code during MultiQC execution +- New Preseq module +- New design for general statistics table (snazzy new background bars) +- Further development of toolbox + - New button to clear all filters + - Warnings when samples are hidden, plus empty plots and table cols are hidden + - Active toolbar tab buttons are highlighted +- Lots of refactoring by @moonso to please the Pythonic gods + - Switched to click instead of argparse to handle command line arguments + - Code generally conforms to best practices better now. +- Now able to supply multiple directories to search for reports +- Logging output improved (now controlled by `-q` and `-v` for quiet and verbose) +- More HTML output dealt with by the base module, less left to the modules + - Module introduction text + - General statistics table now much easier to add to (new helper functions) +- Images, CSS and Javascript now included in HTML, meaning that there is a single + report file to make sharing easier +- More accessible scrolling in the report - styled scrollbars and 'to top' button. +- Modules and templates now use setuptools entry points, facilitating plugins + by other packages. Allows niche extensions whilst keeping the core codebase clean. +- The general stats table now has a sticky header row when scrolling, thanks to + some new javascript wizardry... +- General stats columns can have a _shared key_ which allows common colour schemes + and data ranges. For instance, all columns describing a read count will now share + their scale across modules. +- General stats columns can be hidden and reordered with a new modal window. +- Plotting code refactored, reports with many samples (>50 by default) don't + automatically render to avoid freezing the browser. +- Plots with highlighted and renamed samples now honour this when exporting to + different file types. diff --git a/changelog/multiqc/v0.4.mdx b/changelog/multiqc/v0.4.mdx new file mode 100644 index 000000000..6fa148a1e --- /dev/null +++ b/changelog/multiqc/v0.4.mdx @@ -0,0 +1,22 @@ +--- +title: MultiQC v0.4 +date: 2016-02-16 +tags: [multiqc] +--- + +Latest release of MultiQC with some tasty new functions.. +- New `multiqc_sources.txt` which identifies the paths used to collect all report data for each sample +- Export parsed data as tab-delimited text, `JSON` or `YAML` using the new `-k`/`--data-format` command line option +- Updated HighCharts from `v4.2.2` to `v4.2.3`, fixes tooltip hover bug. +- Nicer export button. Now tied to the export toolbox, hopefully more intuitive. +- FastQC: Per base sequence content heatmap can now be clicked to show line graph for single sample +- FastQC: No longer show adapter contamination datasets with <e; 0.1% contamination. +- Picard: Added support for `CollectOxoGMetrics` reports. +- Changed command line option `--name` to `--filename` +- `--name` also used for filename if `--filename` not specified. +- Hide samples toolbox now has switch to _show only_ matching samples +- New regex help box with examples added to report +- New button to copy general stats table to the clipboard +- General Stats table 'floating' header now sorts properly when scrolling +- Bugfix: MultiQC default_dev template now copies module assets properly +- Bufgix: General Stats table floating header now resizes properly when page width changes diff --git a/changelog/multiqc/v0.5.mdx b/changelog/multiqc/v0.5.mdx new file mode 100644 index 000000000..c26747b40 --- /dev/null +++ b/changelog/multiqc/v0.5.mdx @@ -0,0 +1,32 @@ +--- +title: MultiQC v0.5 +date: 2016-03-29 +tags: [multiqc] +--- + +Latest version of MultiQC. Key highlights are **big reports** (hundreds / thousands of samples now possible), numerous **new modules**, better **plugin framework** and a bunch of tweaks for smoother running. + +Changelog: +- New [Skewer](https://github.com/relipmoc/skewer) module, written by @dakl +- New [Samblaster](https://github.com/GregoryFaust/samblaster) module, written by @dakl +- New [Samtools stats](http://www.htslib.org/) module, written by @lpantano +- New [HiCUP](http://www.bioinformatics.babraham.ac.uk/projects/hicup/) module +- New [SnpEff](http://snpeff.sourceforge.net/) module +- New [methylQA](http://methylqa.sourceforge.net/) module +- New "Flat" image plots, rendered at run time with MatPlotLib + - By default, will use image plots if > 50 samples (set in config as `plots_flat_numseries`) + - Means that _very_ large numbers of samples can be viewed in reports. _eg._ single cell data. + - Templates can now specify their own plotting functions + - Use `--flat` and `--interactive` to override this behaviour +- MultiQC added to `bioconda` (with help from @dakl) +- New plugin hook: `config_loaded` +- Plugins can now add new command line options (thanks to @robinandeer) +- Changed default data directory name from `multiqc_report_data` to `multiqc_data` +- Removed support for depreciated MultiQC_OSXApp +- Updated logging so that a verbose `multiqc_data/.multiqc.log` file is always written +- Now logs more stuff in verbose mode - command used, user configs and so on. +- Added a call to multiqc.info to check for new versions. Disable with config `no_version_check` +- Removed general stats manual row sorting. +- Made filename matching use glob unix style filename match patterns +- Everything (including the data directory) is now created in a temporary directory and moved when MultiQC is complete. +- A handful of performance updates for large analysis directories diff --git a/changelog/multiqc/v0.6.mdx b/changelog/multiqc/v0.6.mdx new file mode 100644 index 000000000..9e424138d --- /dev/null +++ b/changelog/multiqc/v0.6.mdx @@ -0,0 +1,38 @@ +--- +title: MultiQC v0.6 +date: 2016-04-29 +tags: [multiqc] +--- + +Date released: 2016-04-29 + +Key highlights in this report are **new plot types**! Beeswarm and generalised tables. **Three new modules**, a major internal **code refactoring** around plotting and tables (now easier to understand, maintain and add to) and a whole swath of other minor module updates, new functions and features.. + +Changelog: +- New [Salmon](http://combine-lab.github.io/salmon/) module. +- New [Trimmomatic](http://www.usadellab.org/cms/?page=trimmomatic) module. +- New [Bamtools stats](https://github.com/pezmaster31/bamtools) module. +- New beeswarm plot type. General Stats table replaced with this when many samples in report. +- New RSeQC module: Actually a suite of 8 new modules supporting various outputs from RSeQC +- Rewrote bowtie2 module: Now better at parsing logs and tries to scrape input from wrapper logs. +- Made cutadapt show counts by default instead of obs/exp +- Dynamic plots now update their labels properly when changing datasets and to percentages +- Config files now loaded from working directory if present +- Started new docs describing how each module works +- Refactored featureCounts module. Now handles summaries describing multiple samples. +- Stopped using so many hidden files. `.multiqc.log` now called `multiqc.log` +- New `-c`/`--config` command line option to specify a MultiQC configuration file +- Can now load run-specific config files called `multiqc_config.yaml` in working directory +- Large code refactoring - moved plotting code out of `BaseModule` and into new `multiqc.plots` submodules +- Generalised code used to generate the General Stats table so that it can be used by modules +- Removed interactive report tour, replaced with a link to a youtube tutorial +- Made it possible to permanently hide the blue welcome message for all future reports +- New option to smooth data for line plots. Avoids mega-huge plots. Applied to SnpEff, RSeQC, Picard. +- Added percentage view to Picard insert size plot +- Bugfix: Qualimap handles infinity symbol (thanks @chapmanb ) +- Bugfix: Made SnpEff less fussy about required fields for making plots +- Bufgix: UTF-8 file paths handled properly in Py2.7+ +- Bugfix: Extending two config variables wasn't working. Now fixed. +- Bugfix: Dragging the height bar of plots now works again. +- Bugfix: Plots now properly change y axis limits and labels when changing datasets +- Bugfix: Flat plots now have correct path in `default_dev` template diff --git a/changelog/multiqc/v0.7.mdx b/changelog/multiqc/v0.7.mdx new file mode 100644 index 000000000..b810ac8b3 --- /dev/null +++ b/changelog/multiqc/v0.7.mdx @@ -0,0 +1,86 @@ +--- +title: MultiQC v0.7 +date: 2016-07-04 +tags: [multiqc] +--- + +## Version 0.7 of MultiQC! + +This is quite a big release: 141 commits since v0.6, with 4,587 new lines of code and 2,116 lines deleted (or updated), affecting 75 files. Many thanks to everyone for your patience. + +### MultiQC is published! + +If you didn't hear about it - the reason that I wanted to keep the main release stable was because the MultiQC paper was under review. It went well, and MultiQC is now published! You can see it here: + +> **MultiQC: Summarize analysis results for multiple tools and samples in a single report** +> _Philip Ewels, Måns Magnusson, Sverker Lundin and Max Käller_ +> Bioinformatics (2016) +> doi: [10.1093/bioinformatics/btw354](http://dx.doi.org/10.1093/bioinformatics/btw354) +> PMID: [27312411](http://www.ncbi.nlm.nih.gov/pubmed/27312411) + +Many thanks to everyone involved. + +### Module updates: + +Not a huge number of new modules this time, but lots of fixed bugs and quite a few big extensions / refactoring of big modules. +- [**Kallisto**](https://pachterlab.github.io/kallisto/) - new module! +- **Picard** + - Code refactored to make maintenance and additions easier. + - Big update to `HsMetrics` parsing - more results shown in report, new plots (by @lpantano) + - Updated `InsertSizeMetrics` to understand logs generated by `CollectMultipleMetrics` (#215) + - Newlines in picard output. Fixed by @dakl +- **Samtools** + - Code refactored + - Rewrote the `samtools stats` code to display more stats in report with a beeswarm plot. +- **Qualimap** + - Rewritten to use latest methods and fix bugs. + - Added _Percentage Aligned_ column to general stats for `BamQC` module. + - Extra table thresholds added by @avilella (hidden by default) +- **General Statistics** + - Some tweaks to the display defaults (FastQC, Bismark, Qualimap, SnpEff) + - Now possible to skip the General Statistics section of the report with `--exclude general_stats` +- **Cutadapt** module updated to recognise logs from old versions of cutadapt (<e; v1.6) +- **Trimmomatic** + - Now handles `,` decimal places in percentage values. + - Can cope with line breaks in log files (see issue #212) +- **FastQC** refactored + - Now skips zip files if the sample name has already been found. Speeds up MultiQC execution. + - Code cleaned up. Parsing and data-structures standardised. + - New popovers on Pass / Warn / Fail status bars showing sample names. Fast highlighting and hiding. + - New column in General Stats (hidden by default) showing percentage of FastQC modules that failed. +- **SnpEff** + - Search pattern now more generic, should match reports from others. + - _Counts by Effect_ plot removed (had hundreds of categories, was fairly unusable). + - `KeyError` bug fixed. +- **Samblaster** now gets sample name from `ID` instead of `SM` (@dakl) +- **Bowtie 2** + - Now parses overall alignment rate as intended. + - Now depends on even less log contents to work with more inputs. +- **MethylQA** now handles variable spacing in logs +- **featureCounts** now splits columns on tabs instead of whitespace, can handle filenames with spaces + +### Core updates: +- **Galaxy**: MultiQC now available in Galaxy! Work by @devengineson / @yvanlebras / @cmonjeau + - See it in the [Galaxy Toolshed](https://toolshed.g2.bx.psu.edu/view/engineson/multiqc/) +- **Heatmap**: New plot type! +- **Scatter Plot**: New plot type! +- **Download raw data** behind plots in reports! Available in the Export toolbox. + - Choose from tab-separated, comma-separated and the complete JSON. +- **Table columns can be hidden** on page load (shown through _Configure Columns_) + - Defaults are configurable using the `table_columns_visible` config option. +- **Beeswarm plot**: Added missing rename / highlight / hiding functionality. +- New `-l` / `--file-list` option: specify a file containing a **list of files** to search. +- **Updated HighCharts** to v4.2.5. Added option to export to JPEG. +- Can now **cancel execution** with a single `ctrl+c` rather than having to button mash +- More granular control of **skipping files** during scan (filename, dirname, path matching) + - Fixed `--exclude` so that it works with directories as well as files +- **New _Clear_ button** in toolbox to bulk remove highlighting / renaming / hiding filters. +- Improved documentation about behaviour for large sample numbers. +- Handle YAML parsing errors for the config file more gracefully +- Removed empty columns from tables again +- Fixed bug in changing module search patterns, reported by @lweasel +- Added timeout parameter to version check to prevent hang on systems with long defaults +- Fixed table display bug in Firefox +- Fixed bug related to order in which config files are loaded +- Fixed bug that broke the _"Show only"_ toolbox feature with multiple names. +- Numerous other small bugs. diff --git a/changelog/multiqc/v0.8.mdx b/changelog/multiqc/v0.8.mdx new file mode 100644 index 000000000..6db2e948a --- /dev/null +++ b/changelog/multiqc/v0.8.mdx @@ -0,0 +1,70 @@ +--- +title: MultiQC v0.8 +date: 2016-09-26 +tags: [multiqc] +--- + +Module updates: +- [**GATK**](https://software.broadinstitute.org/gatk/) - new module! + - Added support for VariantEval reports, only parsing a little of the information + in there so far, but it's a start. + - Module originally written by @robinandeer at the [OBF Codefest](https://www.open-bio.org/wiki/Codefest_2016), + finished off by @ewels +- [**Bcftools**](https://samtools.github.io/bcftools/) - new module! +- [**QUAST**](http://quast.bioinf.spbau.ru/) - new module! + - QUAST is a tool for assessing de novo assemblies against reference genomes. +- **Bismark** now supports reports from `bam2nuc`, giving Cytosine coverage in General Stats. +- **Bowtie1** + - Updated to try to find bowtie command before log, handle multiple logs in one file. Same as bowtie2. +- **FastQC** + - Sample pass/warn/fail lists now display properly even with large numbers of samples + - Sequence content heatmap display is better with many samples +- **Kallisto** + - Now supports logs from SE data. +- **Picard** + - `BaseDistributionByCycle` - new submodule! Written by @mlusignan + - `RnaSeqMetrics` - new submodule! This one by @ewels ;) + - `AlignmentSummaryMetrics` - another new submodule! + - Fixed truncated files crash bug for Python 3 _(#306)_ +- **Qualimap RNASeqQC** + - Fixed parsing bug affecting counts in _Genomic Origin_ plot. + - Module now works with European style thousand separators (`1.234,56` instead of `1,234.56`) +- **RSeQC** + - `infer_experiment` - new submodule! Written by @Hammarn +- **Samtools** + - `stats` submodule now has separate bar graph showing alignment scores + - `flagstat` - new submodule! Written by @HLWiencko + - `idxstats` - new submodule! This one by @ewels again + +Core updates: +- New `--export`/`-p` option to generate static images plot in `multiqc_plots` (`.png`, `.svg` and `.pdf`) + - Configurable with `export_plots`, `plots_dir_name` and `export_plot_formats` config options + - `--flat` option no longer saves plots in `multiqc_data/multiqc_plots` +- New `--comment`/`-b` flag to add a comment to the top of reports. +- New `--dirs-depth`/`-dd` flag to specify how many directories to prepend with `--dirs`/`-d` + - Specifying a postive number will take that many directories from the end of the path + - A negative number will take directories from the start of the path. +- Directory paths now appended before cleaning, so `fn_clean_exts` will now affect these names. +- New `custom_logo` attributes to add your own logo to reports. +- New `report_header_info` config option to add arbitrary information to the top of reports. +- New `--pdf` option to create a PDF report + - Depends on [Pandoc](http://pandoc.org) being installed and is in a beta-stage currently. + - Note that specifying this will make MultiQC use the `simple` template, giving a HTML report with + much reduced functionality. +- New `fn_clean_sample_names` config option to turn off sample name cleaning + - This will print the full filename for samples. Less pretty reports and rows + on the General Statistics table won't line up, but can prevent overwriting. +- Table header defaults can now be set easily +- General Statistics table now hidden if empty. +- Some new defaults in the sample name cleaning +- Updated the `simple` template. + - Now has no toolbox or nav, no JavaScript and is better suited for printing / PDFs. + - New `config.simple_output` config flag so code knows when we're trying to avoid JS. +- Fixed some bugs with config settings (eg. template) being overwritten. +- NFS log file deletion bug fixed by @brainstorm (#265) +- Fixed bug in `--ignore` behaviour with directory names. +- Fixed nasty bug in beeswarm dot plots where sample names were mixed up (#278) +- Beeswarm header text is now more informative (sample count with more info on a tooltip) +- Beeswarm plots now work when reports have > 1000 samples + +Many thanks to those at the [OpenBio Codefest 2016](https://www.open-bio.org/wiki/Codefest_2016) who worked on MultiQC projects. diff --git a/changelog/multiqc/v0.9.mdx b/changelog/multiqc/v0.9.mdx new file mode 100644 index 000000000..66517876e --- /dev/null +++ b/changelog/multiqc/v0.9.mdx @@ -0,0 +1,84 @@ +--- +title: MultiQC v0.9 +date: 2016-12-21 +tags: [multiqc] +--- + +A major new feature is released in v0.9 - support for _custom content_. This means that MultiQC can now easily include output from custom scripts within reports without the need for a new module or plugin. For more information, please see the [MultiQC documentation](http://multiqc.info/docs/#custom-content). + +Module updates: +- [**HTSeq**](http://www-huber.embl.de/HTSeq/doc/count.html) - new module! + - New module for the `htseq-count` tool, often used in RNA-seq analysis. +- [**Prokka**](http://www.vicbioinformatics.com/software.prokka.shtml) - new module! + - Prokka is a software tool for the rapid annotation of prokaryotic genomes. +- [**Slamdunk**](http://t-neumann.github.io/slamdunk/) - new module! + - Slamdunk is a software tool to analyze SLAMSeq data. +- [**Peddy**](https://github.com/brentp/peddy) - new module! + - Peddy calculates genotype :: pedigree correspondence checks, ancestry checks and sex checks using VCF files. +- **Cutadapt** + - Fixed bug in General Stats table number for old versions of cutadapt (pre v1.7) + - Added support for _really_ old cutadapt logs (eg. v.1.2) +- **FastQC** + - New plot showing total overrepresented sequence percentages. + - New option to parse a file containing a theoretical GC curve to display in the background. + - Human & Mouse Genome / Transcriptome curves bundled, or make your own using [fastqcTheoreticalGC](https://github.com/mikelove/fastqcTheoreticalGC). See the [MultiQC docs](http://multiqc.info/docs/#fastqc) for more information. +- **featureCounts** + - Added parsing checks and catch failures for when non-featureCounts files are picked up by accident +- **GATK** + - Fixed logger error in VariantEval module. +- **Picard** + - Fixed missing sample overwriting bug in `RnaSeqMetrics` + - New feature to customise coverage shown from `HsMetrics` in General Statistics table + see the [docs](http://multiqc.info/docs/#picard) for info). + - Fixed compatibility problem with output from `CollectMultipleMetrics` for `CollectAlignmentSummaryMetrics` +- **Preseq** + - Module now recognises output from `c_curve` mode. +- **RSeQC** + - Made the gene body coverage plot show the percentage view by default + - Made gene body coverage properly handle sample names +- **Samtools** + - New module to show duplicate stats from `rmdup` logs + - Fixed a couple of niggles in the idxstats plot +- **SnpEff** + - Fixed swapped axis labels in the Variant Quality plot +- **STAR** + - Fixed crash when there are 0 unmapped reads. + - Sample name now taken from the directory name if no file prefix found. +- **Qualimap BamQC** + - Add a line for pre-calculated reference genome GC content + - Plot cumulative coverage for values above 50x, align with the coverage histogram. + - New ability to customise coverage thresholds shown in General Statistics table + (see the [docs](http://multiqc.info/docs/#qualimap) for info). + +Core Updates: +- Support for _custom content_ (see top of release notes). +- New ninja report tool: make scatter plots of any two table columns! +- Plot data now saved in `multiqc_data` when 'flat' image plots are created + - Allows you easily re-plot the data (eg. in Excel) for further downstream investigation +- Added _'Apply'_ button to Highlight / Rename / Hide. + - These tools can become slow with large reports. This means that you can enter several + things without having to wait for the report to replot each change. +- Report heatmaps can now be sorted by highlight +- New config options `decimalPoint_format` and `thousandsSep_format` + - Allows you to change the default `1 234.56` number formatting for plots. +- New config option `top_modules` allows you to specify modules that should come at the top of the report +- Fixed bar plot bug where missing categories could shift data between samples +- Report title now printed in the side navigation +- Missing plot IDs added for easier plot exporting +- Stopped giving warnings about skipping directories (now a debug message) +- Added warnings in report about missing functionality for flat plots (exporting and toolbox) +- Export button has contextual text for images / data +- Fixed a bug where user config files were loaded twice +- Fixed bug where module order was random if `--module` or `--exclude` was used. +- Refactored code so that the order of modules can be changed in the user config +- Beefed up code + docs in scatter plots back end and multiple bar plots. +- Fixed a few back end nasties for Tables + - Shared-key columns are no longer forced to share colour schemes + - Fixed bug in lambda modified values when format string breaks + - Supplying just data with no header information now works as advertised +- Improvements to back end code for bar plots + - New `tt_decimals` and `tt_suffix` options for bar plots + - Bar plots now support `yCeiling`, `yFloor` and `yMinRange`, as with line plots. + - New option `hide_zero_cats:False` to force legends to be shown even when all data is 0 +- General Stats _Showing x of y_ columns count is fixed on page load. +- Big code whitespace cleanup diff --git a/changelog/multiqc/v1.0.mdx b/changelog/multiqc/v1.0.mdx new file mode 100644 index 000000000..e062c3188 --- /dev/null +++ b/changelog/multiqc/v1.0.mdx @@ -0,0 +1,155 @@ +--- +title: MultiQC v1.0 +date: 2017-05-17 +tags: [multiqc] +--- + +Version 1.0! This release has been a long time coming and brings with it some fairly +major improvements in speed, report filesize and report performance. There's also +a bunch of new modules, more options, features and a whole lot of bug fixes. + +The version number is being bumped up to 1.0 for a couple of reasons: + +1. MultiQC is now _(hopefully)_ relatively stable. A number of facilities and users + are now using it in a production setting and it's published. It feels like it + probably deserves v1 status now somehow. +2. This update brings some fairly major changes which will break backwards + compatibility for plugins. As such, semantic versioning suggests a change in + major version number. + +### Breaking Changes +For most people, you shouldn't have any problems upgrading. There are two +scenarios where you may need to make changes with this update: + +#### 1. You have custom file search patterns +Search patterns have been flattened and may no longer have arbitrary depth. +For example, you may need to change the following: +```yaml +fastqc: + data: + fn: 'fastqc_data.txt' + zip: + fn: '*_fastqc.zip' +``` +to this: +```yaml +fastqc/data: + fn: 'fastqc_data.txt' +fastqc/zip: + fn: '*_fastqc.zip' +``` +See the [documentation](http://multiqc.info/docs/#step-1-find-log-files) for instructions on how to write the new file search syntax. + +See [`search_patterns.yaml`](https://github.com/MultiQC/MultiQC/blob/main/multiqc/search_patterns.yaml) for the new module search keys +and more examples. + +#### 2. You have custom plugins / modules / external code +To see what changes need to applied to your custom plugin code, please see the [MultiQC docs](http://multiqc.info/docs/#v1.0-updates). + +### Module updates: +* [**Adapter Removal**](https://github.com/mikkelschubert/adapterremoval) - new module! + * AdapterRemoval v2 - rapid adapter trimming, identification, and read merging +* [**BUSCO**](http://busco.ezlab.org/) - new module! + * New module for the `BUSCO v2` tool, used for assessing genome assembly and annotation completeness. +* [**Cluster Flow**](http://clusterflow.io) - new module! + * Cluster Flow is a workflow tool for bioinformatics pipelines. The new module parses executed tool commands. +* [**RNA-SeQC**](http://archive.broadinstitute.org/cancer/cga/rna-seqc) - new module! + * New module to parse output from RNA-SeQC, a java program which computes a series + of quality control metrics for RNA-seq data. +* [**goleft indexcov**](https://github.com/brentp/goleft/tree/master/indexcov) - new module! Thanks to @chapmanb and @brentp + * [goleft indexcov](https://github.com/brentp/goleft/tree/master/indexcov) uses the PED and ROC + data files to create diagnostic plots of coverage per sample, helping to identify sample gender and coverage issues. +* [**SortMeRNA**](http://bioinfo.lifl.fr/RNA/sortmerna/) - new module! Written by @bschiffthaler + * New module for `SortMeRNA`, commonly used for removing rRNA contamination from datasets. +* **Bcftools** + * Fixed bug with display of indels when only one sample +* **Cutadapt** + * Now takes the filename if the sample name is `-` (stdin). Thanks to @tdido +* **FastQC** + * Data for the Sequence content plot can now be downloaded from reports as a JSON file. +* **FastQ Screen** + * Rewritten plotting method for high sample numbers plot (~ > 20 samples) + * Now shows counts for single-species hits and bins all multi-species hits + * Allows plot to show proper percentage view for each sample, much easier to interpret. +* **HTSeq** + * Fix bug where header lines caused module to crash +* **Picard** + * New `RrbsSummaryMetrics` Submodule! + * New `WgsMetrics` Submodule! + * `CollectGcBiasMetrics` module now prints summary statistics to `multiqc_data` if found. Thanks to @ahvigil +* **Preseq** + * Now trims the x axis to the point that meets 90% of `min(unique molecules)`. + Hopefully prevents ridiculous x axes without sacrificing too much useful information. + * Allows to show estimated depth of coverage instead of less informative molecule counts + (see [details](http://multiqc.info/docs/#preseq)). + * Plots dots with externally calculated real read counts (see [details](http://multiqc.info/docs/#preseq)). +* **Qualimap** + * RNASeq Transcript Profile now has correct axis units. Thanks to @roryk + * BamQC module now doesn't crash if reports don't have genome gc distributions +* **RSeQC** + * Fixed Python3 error in Junction Saturation code + * Fixed JS error for Junction Saturation that made the single-sample combined plot only show _All Junctions_ + +### Core MultiQC updates: +* Change in module structure and import statements (see [details](http://multiqc.info/docs/#v1.0-updates)). +* Module file search has been rewritten (see above changes to configs) + * Significant improvement in search speed (test dataset runs in approximately half the time) + * More options for modules to find their logs, eg. filename and contents matching regexes (see the [docs](http://multiqc.info/docs/#step-1-find-log-files)) +* Report plot data is now compressed, significantly reducing report filesizes. +* New `--ignore-samples` option to skip samples based on parsed sample name + * Alternative to filtering by input filename, which doesn't always work + * Also can use config vars `sample_names_ignore` (glob patterns) and `sample_names_ignore_re` (regex patterns). +* New `--sample-names` command line option to give file with alternative sample names + * Allows one-click batch renaming in reports +* New `--cl_config` option to supply MultiQC config YAML directly on the command line. +* New config option to change numeric multiplier in General Stats + * For example, if reports have few reads, can show `Thousands of Reads` instead of `Millions of Reads` + * Set config options `read_count_multiplier`, `read_count_prefix` and `read_count_desc` +* Config options `decimalPoint_format` and `thousandsSep_format` now apply to tables as well as plots + * By default, thosands will now be separated with a space and `.` used for decimal places. +* Tables now have a maximum-height by default and scroll within this. + * Speeds up report rendering in the web browser and makes report less stupidly long with lots of samples + * Button beneath table toggles full length if you want a zoomed-out view + * Refactored and removed previous code to make the table header "float" + * Set `config.collapse_tables` to `False` to disable table maximum-heights +* Bar graphs and heatmaps can now be zoomed in on + * Interactive plots sometimes hide labels due to lack of space. These can now be zoomed in on to see specific samples in more detail. +* Report plots now load sequentially instead of all at once + * Prevents the browser from locking up when large reports load +* Report plot and section HTML IDs are now sanitised and checked for duplicates +* New template available (called _sections_) which has faster loading + * Only shows results from one module at a time + * Makes big reports load in the browser much more quickly, but requires more clicking + * Try it out by specifying `-t sections` +* Module sections tidied and refactored + * New helper function `self.add_section()` + * Sections hidden in nav if no title (no more need for the hacky `self.intro += `) + * Content broken into `description`, `help` and `plot`, with automatic formatting + * Empty module sections are now skipped in reports. No need to check if a plot function returns `None`! + * Changes should be backwards-compatible +* Report plot data export code refactored + * Now doesn't export hidden samples (uses HighCharts [export-csv](https://github.com/highcharts/export-csv) plugin) +* Handle error when `git` isn't installed on the system. +* Refactored colouring of table cells + * Was previously done in the browser using [chroma.js](http://gka.github.io/chroma.js/) + * Now done at report generation time using the [spectra](https://pypi.python.org/pypi/spectra) package + * Should helpfully speed up report rendering time in the web browser, especially for large reports +* Docs updates (thanks to @varemo) +* Previously hidden log file `.multiqc.log` renamed to `multiqc.log` in `multiqc_data` +* Added option to load MultiQC config file from a path specified in the environment variable `MULTIQC_CONFIG_PATH` +* New table configuration options + * `sortRows: False` prevents table rows from being sorted alphabetically + * `col1_header` allows the default first column header to be changed from "Sample Name" +* Tables no longer show _Configure Columns_ and _Plot_ buttons if they only have a single column +* Custom content updates + * New `custom_content`/`order` config option to specify order of Custom Content sections + * Tables now use the header for the first column instead of always having `Sample Name` + * JSON + YAML tables now remember order of table columns + * Many minor bugfixes +* Line graphs and scatter graphs axis limits + * If limits are specified, data exceeding this is no longer saved in report + * Visually identical, but can make report file sizes considerable smaller in some cases +* Creating multiple plots without a config dict now works (previously just gave grey boxes in report) +* All changes are now tested on a Windows system, using [AppVeyor](https://ci.appveyor.com/project/ewels/multiqc/) +* Fixed rare error where some reports could get empty General Statistics tables when no data present. +* Fixed minor bug where config option `force: true` didn't work. Now you don't have to always specify `-f`! diff --git a/changelog/multiqc/v1.1.mdx b/changelog/multiqc/v1.1.mdx new file mode 100644 index 000000000..1073dad0b --- /dev/null +++ b/changelog/multiqc/v1.1.mdx @@ -0,0 +1,84 @@ +--- +title: MultiQC v1.1 +date: 2017-07-18 +tags: [multiqc] +--- + + +#### New Modules: + +* [**BioBloom Tools**](https://github.com/bcgsc/biobloom) + * Create Bloom filters for a given reference and then to categorize sequences +* [**Conpair**](https://github.com/nygenome/Conpair) + * Concordance and contamination estimator for tumor–normal pairs +* [**Disambiguate**](https://github.com/AstraZeneca-NGS/disambiguate) + * Bargraph displaying the percentage of reads aligning to two different reference genomes. +* [**Flexbar**](https://github.com/seqan/flexbar) + * Flexbar is a tool for flexible barcode and adapter removal. +* [**HISAT2**](https://ccb.jhu.edu/software/hisat2/) + * New module for the HISAT2 aligner. + * Made possible by updates to HISAT2 logging by @infphilo (requires `--new-summary` HISAT2 flag). +* [**HOMER**](http://homer.ucsd.edu/homer/) + * Support for summary statistics from the `findPeaks` tool. +* [**Jellyfish**](http://www.cbcb.umd.edu/software/jellyfish/) + * Histograms to estimate library complexity and coverage from k-mer content. + * Module written by @vezzi +* [**MACS2**](https://github.com/taoliu/MACS) + * Summary of redundant rate from MACS2 peak calling. +* [**QoRTs**](http://hartleys.github.io/QoRTs/) + * QoRTs is toolkit for analysis, QC and data management of RNA-Seq datasets. +* [**THetA2**](http://compbio.cs.brown.edu/projects/theta/) + * THeTA2 _(Tumor Heterogeneity Analysis)_ estimates tumour purity and clonal / subclonal copy number. + +#### Module updates: + +* **BCFtools** + * Option to collapse complementary changes in substitutions plot, useful for non-strand specific experiments (thanks to @vladsaveliev) +* **Bismark** + * M-Bias plots no longer show read 2 for single-end data. +* **Custom Content** + * New option to print raw HTML content to the report. +* **FastQ Screen** + * Fixed edge-case bug where many-sample plot broke if total number of reads was less than the subsample number. + * Fixed incorrect logic of config option `fastqscreen_simpleplot` (thanks to @daler) + * Organisms now alphabetically sorted in fancy plot so that order is nonrandom (thanks to @daler) + * Fixed bug where `%No Hits` was missed in logs from recent versions of FastQ Screen. +* **HTSeq Counts** + * Fixed but so that module still works when `--additional-attr` is specified in v0.8 HTSeq above (thanks to @nalcala) +* **Picard** + * CollectInsertSize: Fixed bug that could make the General Statistics _Median Insert Size_ value incorrect. + * Fixed error in sample name regex that left trailing `]` characters and was generally broken (thanks to @jyh1 for spotting this) +* **Preseq** + * Improved plots display (thanks to @vladsaveliev) +* **Qualimap** + * Only calculate bases over target coverage for values in General Statistics. Should give a speed increase for very high coverage datasets. +* **QUAST** + * Module is now compatible with runs from [MetaQUAST](http://quast.sourceforge.net/metaquast) (thanks to @vladsaveliev) +* **RSeQC** + * Changed default order of sections + * Added config option to reorder and hide module report sections + +#### New MultiQC features: + +* If a report already exists, execution is no longer halted. + * `_1` is appended to the filename, iterating if this also exists. + * `-f`/`--force` still overwrites existing reports as before + * Feature written by [@Hammarn](https://github.com/Hammarn) +* New ability to run modules multiple times in a single report + * Each run can be given different configuration options, including filters for input files + * For example, have FastQC after trimming as well as FastQC before trimming. + * See the relevant [documentation](http://multiqc.info/docs/#order-of-modules) for more instructions. +* New option to customise the order of report _sections_ + * This is in addition / alternative to changing the order of module execution + * Allows one module to have sections in multiple places (eg. Custom Content) +* Tables have new column options `floor`, `ceiling` and `minRange`. +* Reports show warning if JavaScript is disabled +* Config option `custom_logo` now works with file paths relative to config file directory and cwd. + +#### Bug Fixes: + +* Table headers now sort columns again after scrolling the table +* Fixed buggy table header tooltips +* Base `clean_s_name` function now strips excess whitespace. +* Line graphs don't smooth lines if not needed (number of points < maximum number allowed) +* PDF output now respects custom output directory. diff --git a/changelog/multiqc/v1.10.1.mdx b/changelog/multiqc/v1.10.1.mdx new file mode 100644 index 000000000..fb8321606 --- /dev/null +++ b/changelog/multiqc/v1.10.1.mdx @@ -0,0 +1,36 @@ +--- +title: MultiQC v1.10.1 +date: 2021-03-31 +tags: [multiqc] +--- + +This is a relatively small release focussing just on bug fixes 🐛 - the last release revealed a couple of nasty ones which I felt were bad enough to justify a fast patch.. _(99 bugs - fix 1, now you've got 103 bugs)_ + +Many thanks to everyone who reports these problems along with example data 🕵🏻 + +### MultiQC updates + +- Allow scientific notation numbers in colour scheme generation + - Fixed bug with very small minimum numbers that only revelead itself after a bugfix done in the v1.10 release +- Require at least `rich` version `9.4.0` to avoid `SpinnerColumn` `AttributeError` ([#1393](https://github.com/ewels/MultiQC/issues/1393)) +- Dropped the `Skipping search pattern` log message from a warning to debug +- Moved directory prepending with `-d` back to before sample name cleaning (as it was before v1.7) ([#1264](https://github.com/ewels/MultiQC/issues/1264)) +- If linegraph plot data goes above `ymax`, only _discard_ the data if the line doesn't come back again ([#1257](https://github.com/ewels/MultiQC/issues/1257)) +- Allow `top_modules` to be specified as empty dicts ([#1274](https://github.com/ewels/MultiQC/issues/1274)) +- Properly ignore `.snakemake` folders as intended ([#1395](https://github.com/ewels/MultiQC/issues/1395)) + +#### Module updates + +- **bcftools** + - Fixed bug where `QUAL` value `.` would crash MultiQC ([#1400](https://github.com/ewels/MultiQC/issues/1400)) +- **bowtie2** + - Fix bug where HiSAT2 paired-end bar plots were missing unaligned reads ([#1230](https://github.com/ewels/MultiQC/issues/1230)) +- **Deeptools** + - Handle `plotProfile` data where no upstream / downstream regions have been calculated around genes ([#1317](https://github.com/ewels/MultiQC/issues/1317)) + - Fix `IndexError` caused by mysterious `-1` in code.. ([#1275](https://github.com/ewels/MultiQC/issues/1275)) +- **FastQC** + - Replace `NaN` with `0` in the _Per Base Sequence Content_ plot to avoid crashing the plot ([#1246](https://github.com/ewels/MultiQC/issues/1246)) +- **Picard** + - Fixed bug in `ValidateSamFile` module where additional whitespace at the end of the file would cause MultiQC to crash ([#1397](https://github.com/ewels/MultiQC/issues/1397)) +- **Somalier** + - Fixed bug where using sample name cleaning in a config would trigger a `KeyError` ([#1234](https://github.com/ewels/MultiQC/issues/1234)) diff --git a/changelog/multiqc/v1.10.mdx b/changelog/multiqc/v1.10.mdx new file mode 100644 index 000000000..49ee57978 --- /dev/null +++ b/changelog/multiqc/v1.10.mdx @@ -0,0 +1,123 @@ +--- +title: MultiQC v1.10 +date: 2021-03-08 +tags: [multiqc] +--- + +Many thanks to everyone's patience in waiting for this release, it is much appreciated! + +### Update for developers: Code linting + +This is a big change for MultiQC developers. I have added automated code formatting and code linting (style checks) to MultiQC. This helps to keep the MultiQC code base consistent despite having many contributors and helps me to review pull-requests without having to consider whitespace. Specifically, MultiQC now uses three main tools: + +- [Black](https://github.com/psf/black) - Python Code +- [Prettier](https://prettier.io/) - Everything else (almost) +- [markdownlint-cli](https://github.com/igorshubovych/markdownlint-cli) - Stricter markdown rules + +**All developers must run these tools when submitting changes via Pull-Requests!** Automated CI tests now run with GitHub actions to check that all files pass the above tests. If any files do not, that test will fail giving a red :x: next to the pull request. + +For further information, please see the [documentation](https://multiqc.info/docs/#coding-with-multiqc). + +### MultiQC updates + +#### New MultiQC Features + +- `--sample-filters` now also accepts `show_re` and `hide_re` in addition to `show` and `hide`. The `_re` options use regex, while the "normal" options use globbing. +- MultiQC config files now work with `.yml` file extension as well as `.yaml` + - `.yaml` will take preference if both found. +- Section comments can now also be added for _General Statistics_ + - `section_comments: { general_stats: "My comment" }` +- New table header config option `bgcols` allows background colours for table cells with categorical data. +- New table header config options `cond_formatting_rules` and `cond_formatting_colours` + - Comparable functionality to user config options `table_cond_formatting_rules` and `table_cond_formatting_colours`, + allowes module developers to format table cell values as labels. +- New CI test looks for git merge markers in files +- Beautiful new [progress bar](https://rich.readthedocs.io/en/stable/progress.html) from the amazing [willmcgugan/rich](https://github.com/willmcgugan/rich) package. +- Added a bunch of new default sample name trimming suffixes ([see `8ac5c7b`](https://github.com/ewels/MultiQC/commit/8ac5c7b6e4ea6003ca2c9b681953ab3f22c5dd66)) +- Added `timeout-minutes: 10` to the CI test workflow to check that changes aren't negatively affecting run time too much. +- New table header option `bars_zero_centrepoint` to treat `0` as zero width bars and plot bar length based on absolute values + +#### New Modules + +- [**EigenStratDatabaseTools**](https://github.com/TCLamnidis/EigenStratDatabaseTools) + - Added MultiQC module to report SNP coverages from `eigenstrat_snp_coverage.py` in the general stats table. +- [**HOPS**](https://www.github.com/rhubler/HOPS) + - Post-alignment ancient DNA analysis tool for MALT +- [**JCVI**](https://github.com/tanghaibao/jcvi) + - Computes statistics on genome annotation. +- [**ngsderive**](https://github.com/stjudecloud/ngsderive) + - Forensic analysis tool useful in backwards computing information from next-generation sequencing data. +- [**OptiType**](https://github.com/FRED-2/OptiType) + - Precision HLA typing from next-generation sequencing data +- [**PURPLE**](https://github.com/hartwigmedical/hmftools/tree/master/purity-ploidy-estimator) + - A purity, ploidy and copy number estimator for whole genome tumor data +- [**Pychopper**](https://github.com/nanoporetech/pychopper) + - Identify, orient and trim full length Nanopore cDNA reads +- [**qc3C**](https://github.com/cerebis/qc3C) + - Reference-free QC of Hi-C sequencing data +- [**Sentieon**](https://www.sentieon.com/products/) + - Submodules added to catch Picard-based QC metrics files + +#### Module updates + +- **DRAGEN** + - Fix issue where missing out fields could crash the module ([#1223](https://github.com/ewels/MultiQC/issues/1223)) + - Added support for whole-exome / targetted data ([#1290](https://github.com/ewels/MultiQC/issues/1290)) +- **featureCounts** + - Add support for output from [Rsubread](https://bioconductor.org/packages/release/bioc/html/Rsubread.html) ([#1022](https://github.com/ewels/MultiQC/issues/1022)) +- **fgbio** + - Fix `ErrorRateByReadPosition` to calculate `ymax` not just on the overall `error_rate`, but also specific base errors (ex. `a_to_c_error_rate`, `a_to_g_error_rate`, ...). ([#1215](https://github.com/ewels/MultiQC/pull/1251)) + - Fix `ErrorRateByReadPosition` plotted line names to no longer concatenate multiple read identifiers and no longer have off-by-one read numbering (ex. `Sample1_R2_R3` -> `Sample1_R2`) ([#[1304](https://github.com/ewels/MultiQC/pull/1304)) +- **Fastp** + - Fixed description for duplication rate (pre-filtering, not post) ([#[1313](https://github.com/ewels/MultiQC/pull/1313)) +- **GATK** + - Add support for the creation of a "Reported vs Empirical Quality" graph to the Base Recalibration module. +- **hap.py** + - Updated module to plot both SNP and INDEL stats ([#1241](https://github.com/ewels/MultiQC/issues/1241)) +- **indexcov** + - Fixed bug when making the PED file plots ([#1265](https://github.com/ewels/MultiQC/issues/1265)) +- **interop** + - Added the `% Occupied` metric to `Read Metrics per Lane` table which is reported for NovaSeq and iSeq platforms. +- **Kaiju** + - Fixed bug affecting inputs with taxa levels other than Phylum ([#1217](https://github.com/ewels/MultiQC/issues/1217)) + - Rework barplot, add top 5 taxons ([#1219](https://github.com/ewels/MultiQC/issues/1219)) +- **Kraken** + - Fix `ZeroDivisionError` ([#1276](https://github.com/ewels/MultiQC/issues/1276)) + - Add distinct minimizer heatmap for KrakenUniq style duplication information ([#1333](https://github.com/ewels/MultiQC/pull/1380)) +- **MALT** + - Fix y-axis labelling in bargraphs +- **MACS2** + - Add number of peaks to the _General Statistics_ table. +- **mosdepth** + - Enable prepending of directory to sample names + - Display contig names in _Coverage per contig_ plot tooltip +- **Picard** + - Fix `HsMetrics` bait percentage columns ([#1212](https://github.com/ewels/MultiQC/issues/1212)) + - Fix `ConvertSequencingArtifactToOxoG` files not being found ([#1310](https://github.com/ewels/MultiQC/issues/1310)) + - Make `WgsMetrics` histogram smoothed if more than 1000 data points (avoids huge plots that crash the browser) + - Multiple new config options for `WgsMetrics` to customise coverage histogram and speed up MultiQC with very high coverage files. + - Add additional datasets to Picard Alignment Summary ([#1293](https://github.com/ewels/MultiQC/issues/1293)) + - Add support for `CrosscheckFingerprints` ([#1327](https://github.com/ewels/MultiQC/issues/1327)) +- **PycoQC** + - Log10 x-axis for _Read Length_ plot ([#1214](https://github.com/ewels/MultiQC/issues/1214)) +- **Rockhopper** + - Fix issue with parsing genome names in Rockhopper summary files ([#1333](https://github.com/ewels/MultiQC/issues/1333)) + - Fix issue properly parsing multiple samples within a single Rockhopper summary file +- **Salmon** + - Only try to generate a plot for fragment length if the data was found. +- **verifyBamID** + - Fix `CHIP` value detection ([#1316](https://github.com/ewels/MultiQC/pull/1316)). + +#### New Custom Content features + +- General Stats custom content now gives a log message +- If `id` is not set in `JSON` or `YAML` files, it defaults to the sample name instead of just `custom_content` +- Data from `JSON` or `YAML` now has `data` keys (sample names) run through the `clean_s_name()` function to apply sample name cleanup +- Fixed minor bug which caused custom content YAML files with a string `data` type to not be parsed + +#### Bug Fixes + +- Disable preservation of timestamps / modes when copying temp report files, to help issues with network shares ([#1333](https://github.com/ewels/MultiQC/issues/1333)) +- Fixed MatPlotLib warning: `FixedFormatter should only be used together with FixedLocator` +- Fixed long-standing min/max bug with shared minimum values for table columns using `shared_key` +- Made table colour schemes work with negative numbers (don't strip `-` from values when making scheme) diff --git a/changelog/multiqc/v1.11.mdx b/changelog/multiqc/v1.11.mdx new file mode 100644 index 000000000..ec72800d9 --- /dev/null +++ b/changelog/multiqc/v1.11.mdx @@ -0,0 +1,110 @@ +--- +title: MultiQC v1.11 +date: 2021-07-05 +tags: [multiqc] +--- + +A summer release for MultiQC 🥳 🏖️ Many thanks to everyone who has contributed! + +### MultiQC new features + +- New interactive slider controls for controlling heatmap colour scales ([#1427](https://github.com/ewels/MultiQC/issues/1427)) +- Added new `--replace-names` / config `sample_names_replace` option to replace sample names during report generation +- Added `use_filename_as_sample_name` config option / `--fn_as_s_name` command line flag ([#949](https://github.com/ewels/MultiQC/issues/949), [#890](https://github.com/ewels/MultiQC/issues/890), [#864](https://github.com/ewels/MultiQC/issues/864), [#998](https://github.com/ewels/MultiQC/issues/998), [#1390](https://github.com/ewels/MultiQC/issues/1390)) + - Forces modules to use the log filename for the sample identifier, even if the module usually takes this from the file contents + - Required a change to the `clean_s_name()` function arguments. All core MultiQC modules updated to reflect this. + - Should be backwards compatible for custom modules. To adopt new behaviour, supply `f` instead of `f["root"]` as the second argument. + - See the documenation for details: [Using log filenames as sample names](https://multiqc.info/docs/#using-log-filenames-as-sample-names) and [Custom sample names](https://multiqc.info/docs/#custom-sample-names). + +### MultiQC updates + +- Make the module crash tracebacks much prettier using `rich` +- Refine the cli log output a little (nicely formatted header line + drop the `[INFO]`) +- Added docs describing tools for downstream analysis of MultiQC outputs. +- Added CI tests for Python 3.9, pinned `networkx` package to `>=2.5.1` ([#1413](https://github.com/ewels/MultiQC/issues/1413)) +- Added patterns to `config.fn_ignore_paths` to avoid error with parsing installation dir / singularity cache ([#1416](https://github.com/ewels/MultiQC/issues/1416)) +- Print a log message when flat-image plots are used due to sample size surpassing `plots_flat_numseries` config ([#1254](https://github.com/ewels/MultiQC/issues/1254)) +- Fix the `mqc_colours` util function to lighten colours even when passing categorical or single-length lists. +- Bugfix for Custom Content, using YAML configuration (eg. section headers) for images should now work + +### New Modules + +- [**BclConvert**](https://support.illumina.com/sequencing/sequencing_software/bcl-convert.html) + - Tool that converts / demultiplexes Illumina Binary Base Call (BCL) files to FASTQ files +- [**Bustools**](https://bustools.github.io/) + - Tools for working with BUS files +- [**ccs**](https://github.com/PacificBiosciences/ccs) + - Generate highly accurate single-molecule consensus reads from PacBio data +- [**GffCompare**](https://ccb.jhu.edu/software/stringtie/gffcompare.shtml) + - GffCompare can annotate and estimate accuracy of one or more GFF files compared with a reference annotation. +- [**Lima**](https://github.com/PacificBiosciences/barcoding) + - The PacBio Barcode Demultiplexer +- [**NanoStat**](https://github.com/wdecoster/nanostat) + - Calculate various statistics from a long read sequencing datasets +- [**ODGI**](https://github.com/pangenome/odgi) + - Optimized dynamic genome/graph implementation +- [**Pangolin**](https://github.com/cov-lineages/pangolin) + - Added MultiQC support for Pangolin, the tool that determines SARS-CoV-2 lineages +- [**Sambamba Markdup**](https://lomereiter.github.io/sambamba/docs/sambamba-markdup.html) + - Added MultiQC module to add duplicate rate calculated by Sambamba Markdup. +- [**Snippy**](https://github.com/tseemann/snippy) + - Rapid haploid variant calling and core genome alignment. +- [**VEP**](https://www.ensembl.org/info/docs/tools/vep/index.html) + - Added MultiQC module to add summary statistics of Ensembl VEP annotations. + - Handle error from missing variants in VEP stats file. ([#1446](https://github.com/ewels/MultiQC/issues/1446)) + +### Module feature additions + +- **Cutadapt** + - Added support for linked adapters [#1329](https://github.com/ewels/MultiQC/issues/1329)] + - Parse whether trimming was 5' or 3' for _Lengths of Trimmed Sequences_ plot where possible +- **Mosdepth** + - Include or exclude contigs based on patterns for coverage-per-contig plots +- **Picard** + - Add support for `CollectIlluminaBasecallingMetrics`, `CollectIlluminaLaneMetrics`, `ExtractIlluminaBarcodes` and `MarkIlluminaAdapters` ([#1336](https://github.com/ewels/MultiQC/pull/1336)) + - New `insertsize_xmax` configuration option to limit the plotted maximum insert size for `InsertSizeMetrics` +- **Qualimap** + - Added new percentage coverage plot in `QM_RNASeq` ([#1258](https://github.com/ewels/MultiQC/issues/1258)) +- **RSeQC** + - Added a long-requested submodule to support showing the [**TIN**](http://rseqc.sourceforge.net/#tin-py) (Transcript Integrity Number) ([#737](https://github.com/ewels/MultiQC/issues/737)) + +### Module updates + +- **biscuit** + - Duplicate Rate and Cytosine Retention tables are now bargraphs. + - Refactor code to only calculate alignment statistics once. + - Fixed bug where cytosine retentions values would not be properly read if in scientific notation. +- **bcl2fastq** + - Added sample name cleaning so that prepending directories with the `-d` flag works properly. +- **Cutadapt** + - Plot filtered reads even when no filtering category is found ([#1328](https://github.com/ewels/MultiQC/issues/1328)) + - Don't take the last command line string for the sample name if it looks like a command-line flag ([#949](https://github.com/ewels/MultiQC/issues/949)) +- **Dragen** + - Handled MultiQC crashing when run on single-end output from Dragen ([#1374](https://github.com/ewels/MultiQC/issues/1374)) +- **fastp** + - Handle a `ZeroDivisionError` if there are zero reads ([#1444](https://github.com/ewels/MultiQC/issues/1444)) +- **FastQC** + - Added check for if `overrepresented_sequences` is missing from reports ([#1281](https://github.com/ewels/MultiQC/issues/1444)) +- **Flexbar** + - Fixed bug where reports with 0 reads would crash MultiQC ([#1407](https://github.com/ewels/MultiQC/issues/1407)) +- **Kraken** + - Handle a `ZeroDivisionError` if there are zero reads ([#1440](https://github.com/ewels/MultiQC/issues/1440)) + - Updated search patterns to handle edge case ([#1428](https://github.com/ewels/MultiQC/issues/1428)) +- **Mosdepth** + - Show barplot instead of line graph for coverage-per-contig plot if there is only one contig. +- **Picard** + - `RnaSeqMetrics` - fix assignment barplot labels to say bases instead of reads ([#1408](https://github.com/ewels/MultiQC/issues/1408)) + - `CrosscheckFingerprints` - fix bug where LOD threshold was not detected when invoked with "new" picard cli style. fixed formatting bug ([#1414](https://github.com/ewels/MultiQC/issues/1414)) + - Made checker for comma as decimal separator in `HsMetrics` more robust ([#1296](https://github.com/ewels/MultiQC/issues/1296)) +- **qc3C** + - Updated module to not fail on older field names. +- **Qualimap** + - Fixed wrong units in tool tip label ([#1258](https://github.com/ewels/MultiQC/issues/1258)) +- **QUAST** + - Fixed typo causing wrong number of contigs being displayed ([#1442](https://github.com/ewels/MultiQC/issues/1442)) +- **Sentieon** + - Handled `ZeroDivisionError` when input files have zero reads ([#1420](https://github.com/ewels/MultiQC/issues/1420)) +- **RSEM** + - Handled `ZeroDivisionError` when input files have zero reads ([#1040](https://github.com/ewels/MultiQC/issues/1040)) +- **RSeQC** + - Fixed double counting of some categories in `read_distribution` bar graph. ([#1457](https://github.com/ewels/MultiQC/issues/1457)) diff --git a/changelog/multiqc/v1.12.mdx b/changelog/multiqc/v1.12.mdx new file mode 100644 index 000000000..4f7cf3c69 --- /dev/null +++ b/changelog/multiqc/v1.12.mdx @@ -0,0 +1,126 @@ +--- +title: MultiQC v1.12 +date: 2022-02-08 +tags: [multiqc] +--- + +Version 1.12 of MultiQC brings with it a modest number of new modules, a few new core features and a swathe of bugfixes and general improvements. I hope that everyone continues to find it useful! You can see the full changes in this release here: https://github.com/ewels/MultiQC/compare/v1.11...v1.12 + +Special thanks to the 13 people who had their first MultiQC contributions in this release: + +
+New Contributors + +* @HofLucien made their first contribution in https://github.com/ewels/MultiQC/pull/1486 +* @jchorl made their first contribution in https://github.com/ewels/MultiQC/pull/1578 +* @bjohnnyd made their first contribution in https://github.com/ewels/MultiQC/pull/1489 +* @schorlton made their first contribution in https://github.com/ewels/MultiQC/pull/1567 +* @MatthiasZepper made their first contribution in https://github.com/ewels/MultiQC/pull/1584 +* @g-pacheco made their first contribution in https://github.com/ewels/MultiQC/pull/1587 +* @paulstretenowich made their first contribution in https://github.com/ewels/MultiQC/pull/1605 +* @yanick made their first contribution in https://github.com/ewels/MultiQC/pull/1595 +* @MillironX made their first contribution in https://github.com/ewels/MultiQC/pull/1594 +* @sguizard made their first contribution in https://github.com/ewels/MultiQC/pull/1593 +* @maleasy made their first contribution in https://github.com/ewels/MultiQC/pull/1552 +* @TomaszSuchan made their first contribution in https://github.com/ewels/MultiQC/pull/1271 +* @massiddamt made their first contribution in https://github.com/ewels/MultiQC/pull/1021 + +
+ +### ✨ MultiQC - new features + +- Added option to customise default plot height in plot config ([#1432](https://github.com/ewels/MultiQC/issues/1432)) +- Added `--no-report` flag to skip report generation ([#1462](https://github.com/ewels/MultiQC/issues/1462)) +- Added support for priting tool DOI in report sections ([#1177](https://github.com/ewels/MultiQC/issues/1177)) +- Added support for `--custom-css-file` / `config.custom_css_files` option to include custom CSS in the final report ([#1573](https://github.com/ewels/MultiQC/pull/1573)) +- New plot config option `labelSize` to customise font size for axis labels in flat MatPlotLib charts ([#1576](https://github.com/ewels/MultiQC/pull/1576)) +- Added support for customising table column names ([#1255](https://github.com/ewels/MultiQC/issues/1255)) + +### 🔨 MultiQC - updates + +- MultiQC now skips modules for which no files were found - gives a small performance boost ([#1463](https://github.com/ewels/MultiQC/issues/1463)) +- Improvements for running MultiQC in a Python environment, such as a Jupyter Notebook or script + - Fixed logger bugs when calling `multiqc.run` multiple times by removing logging file handlers between calls ([#1141](https://github.com/ewels/MultiQC/issues/1141)) + - Init/reset global state between runs ([#1596](https://github.com/ewels/MultiQC/pull/1596)) +- Added commonly missing functions to several modules ([#1468](https://github.com/ewels/MultiQC/issues/1468)) +- Wrote new script to check for the above function calls that should be in every module (`.github/workflows/code_checks.py`), runs on GitHub actions CI +- Make table _Conditional Formatting_ work at table level as well as column level. ([#761](https://github.com/ewels/MultiQC/issues/761)) +- CSS Improvements to make printed reports more attractive / readable ([#1579](https://github.com/ewels/MultiQC/pull/1579)) +- Fixed a problem with numeric filenames ([#1606](https://github.com/ewels/MultiQC/issues/1606)) +- Fixed nasty bug where line charts with a categorical x-axis would take categories from the last sample only ([#1568](https://github.com/ewels/MultiQC/issues/1568)) +- Ignore any files called `multiqc_data.json` ([#1598](https://github.com/ewels/MultiQC/issues/1598)) +- Check that the config `path_filters` is a list, convert to list if a string is supplied ([#1539](https://github.com/ewels/MultiQC/issues/1539)) + +### 🎁 New Modules + +- [**CheckQC**](https://github.com/Molmed/checkQC) + - A program designed to check a set of quality criteria against an Illumina runfolder +- [**pbmarkdup**](https://github.com/PacificBiosciences/pbmarkdup) + - Mark duplicate reads from PacBio sequencing of an amplified library +- [**WhatsHap**](https://whatshap.readthedocs.io) + - WhatsHap is a software for phasing genomic variants using DNA sequencing reads + +### 🌟 Module feature additions + +- **BBMap** + - Added handling for `qchist` output ([#1021](https://github.com/ewels/MultiQC/issues/1021)) +- **bcftools** + - Added a plot with samplewise number of sites, Ts/Tv, number of singletons and sequencing depth ([#1087](https://github.com/ewels/MultiQC/issues/1087)) +- **Mosdepth** + - Added mean coverage [#1566](https://github.com/ewels/MultiQC/issues/1566) +- **NanoStat** + - Recognize FASTA and FastQ report flavors ([#1547](https://github.com/ewels/MultiQC/issues/1547)) + +### 🐛 Module updates + +- **BBMap** + - Correctly handle adapter stats files with additional columns ([#1556](https://github.com/ewels/MultiQC/issues/1556)) +- **bclconvert** + - Handle change in output format in v3.9.3 with new `Quality_Metrics.csv` file ([#1563](https://github.com/ewels/MultiQC/issues/1563)) +- **bowtie** + - Minor update to handle new log wording in bowtie v1.3.0 ([#1615](https://github.com/ewels/MultiQC/issues/1615)) +- **CCS** + - Tolerate compound IDs generated by pbcromwell ccs in the general statistics ([#1486](https://github.com/ewels/MultiQC/pull/1486)) + - Fix report parsing. Update test on attributes ids ([#1583](https://github.com/ewels/MultiQC/issues/1583)) +- **Custom content** + - Fixed module failing when writing data to file if there is a `/` in the section name ([#1515](https://github.com/ewels/MultiQC/issues/1515)) + - Use filename for section header in files with no headers ([#1550](https://github.com/ewels/MultiQC/issues/1550)) + - Sort custom content bargraph data by default ([#1412](https://github.com/ewels/MultiQC/issues/1412)) + - Always save `custom content` data to file with a name reflecting the section name. ([#1194](https://github.com/ewels/MultiQC/issues/1194)) +- **DRAGEN** + - Fixed bug in sample name regular expression ([#1537](https://github.com/ewels/MultiQC/pull/1537)) +- **Fastp** + - Fixed % pass filter statistics ([#1574](https://github.com/ewels/MultiQC/issues/1574)) +- **FastQC** + - Fixed several bugs occuring when FastQC sections are skipped ([#1488](https://github.com/ewels/MultiQC/issues/1488), [#1533](https://github.com/ewels/MultiQC/issues/1533)) + - Clarify general statistics table header for length +- **goleft/indexcov** + - Fix `ZeroDivisionError` if no bins are found ([#1586](https://github.com/ewels/MultiQC/issues/1586)) +- **HiCPro** + - Better handling of errors when expected data keys are not found ([#1366](https://github.com/ewels/MultiQC/issues/1366)) +- **Lima** + - Move samples that have been renamed using `--replace-names` into the _General Statistics_ table ([#1483](https://github.com/ewels/MultiQC/pull/1483)) +- **miRTrace** + - Replace hardcoded RGB colours with Hex to avoid errors with newer versions of matplotlib ([#1263](https://github.com/ewels/MultiQC/pull/1263)) +- **Mosdepth** + - Fixed issue [#1568](https://github.com/ewels/MultiQC/issues/1568) + - Fixed a bug when reporting per contig coverage +- **Picard** + - Update `ExtractIlluminaBarcodes` to recognise more log patterns in newer versions of Picard ([#1611](https://github.com/ewels/MultiQC/pull/1611)) +- **Qualimap** + - Fix `ZeroDivisionError` in `QM_RNASeq` and skip genomic origins plot if no aligned reads are found ([#1492](https://github.com/ewels/MultiQC/issues/1492)) +- **QUAST** + - Clarify general statistics table header for length +- **RSeQC** + - Fixed minor bug in new TIN parsing where the sample name was not being correctly cleaned ([#1484](https://github.com/ewels/MultiQC/issues/1484)) + - Fixed bug in the `junction_saturation` submodule ([#1582](https://github.com/ewels/MultiQC/issues/1582)) + - Fixed bug where empty files caused `tin` submodule to crash ([#1604](https://github.com/ewels/MultiQC/issues/1604)) + - Fix bug in `read_distribution` for samples with zero tags ([#1571](https://github.com/ewels/MultiQC/issues/1571)) +- **Sambamba** + - Fixed issue with a change in the format of output from `sambamba markdup` 0.8.1 ([#1617](https://github.com/ewels/MultiQC/issues/1617)) +- **Skewer** + - Fix `ZeroDivisionError` if no available reads are found ([#1622](https://github.com/ewels/MultiQC/issues/1622)) +- **Somalier** + - Plot scaled X depth instead of mean for _Sex_ plot ([#1546](https://github.com/ewels/MultiQC/issues/1546)) +- **VEP** + - Handle table cells containing `-` instead of numbers ([#1597](https://github.com/ewels/MultiQC/issues/1597)) diff --git a/changelog/multiqc/v1.13.mdx b/changelog/multiqc/v1.13.mdx new file mode 100644 index 000000000..6ceaf56d0 --- /dev/null +++ b/changelog/multiqc/v1.13.mdx @@ -0,0 +1,43 @@ +--- +title: MultiQC v1.13 +date: 2022-09-08 +tags: [multiqc] +--- + +### MultiQC updates + +- Major spruce of the command line help, using the new [rich-click](https://github.com/ewels/rich-click) package +- Drop some of the Python 2k compatability code (eg. custom requirements) +- Improvements for running MultiQC in a Python environment, such as a Jupyter Notebook or script + - Fixed bug raised when removing logging file handlers between calls that arose when configuring the root logger with dictConfig ([#1643](https://github.com/ewels/MultiQC/issues/1643)) +- Added new config option `custom_table_header_config` to override any config for any table header +- Fixed edge-case bug in custom content where a `description` that doesn't terminate in `.` gave duplicate section descriptions. +- Tidied the verbose log to remove some very noisy statements and add summaries for skipped files in the search +- Add timezone to time in reports +- Add nix flake support +- Added automatic tweet about new releases + +### Module updates + +- **AdapterRemoval** + - Finally merge a fix for counts of reads that are discarded/collapsed ([#1647](https://github.com/ewels/MultiQC/issues/1647)) +- **VEP** + - Fixed bug when `General Statistics` have a value of `-` ([#1656](https://github.com/ewels/MultiQC/pull/1656)) +- **Custom content** + - Only set id for custom content when id not set by metadata ([#1629](https://github.com/ewels/MultiQC/issues/1629)) + - Fix bug where module wouldn't run if all content was within a MultiQC config file ([#1686](https://github.com/ewels/MultiQC/issues/1686)) + - Fix crash when `info` isn't set ([#1688](https://github.com/ewels/MultiQC/issues/1688)) +- **Nanostat** + - Removed HTML escaping of special characters in the log to fix bug in jinja2 v3.10 removing `jinja2.escape()` ([#1659](https://github.com/ewels/MultiQC/pull/1659)) + - Fix bug where module would crash if input does not contain quality scores ([#1717](https://github.com/ewels/MultiQC/issues/1717)) +- **Pangolin** + - Updated module to handle outputs from Pangolin v4 ([#1660](https://github.com/ewels/MultiQC/pull/1660)) +- **Somalier** + - Handle zero mean X depth in _Sex_ plot ([#1670](https://github.com/ewels/MultiQC/pull/1670)) +- **Fastp** + - Include low complexity and too long reads in filtering bar chart +- **miRTop** + - Fix module crashing when `ref_miRNA_sum` is missing in file. ([#1712](https://github.com/ewels/MultiQC/issues/1712)) + - Fix module crashing due to zero division ([#1719](https://github.com/ewels/MultiQC/issues/1719)) +- **FastQC** + - Fixed error when parsing duplicate ratio when there is `nan` values in the report. ([#1725](https://github.com/ewels/MultiQC/pull/1725)) diff --git a/changelog/multiqc/v1.14.mdx b/changelog/multiqc/v1.14.mdx new file mode 100644 index 000000000..2b8003ac7 --- /dev/null +++ b/changelog/multiqc/v1.14.mdx @@ -0,0 +1,117 @@ +--- +title: MultiQC v1.14 +date: 2023-01-08 +tags: [multiqc] +--- + +### MultiQC new features + +- Rewrote the `Dockerfile` to build multi-arch images (amd64 + arm), run through a non-privileged user and build tools for non precompiled python binaries ([#1541](https://github.com/ewels/MultiQC/pull/1541), [#1541](https://github.com/ewels/MultiQC/pull/1541)) +- Add a new lint test to check that colour scale names are valid ([#1835](https://github.com/ewels/MultiQC/pull/1835)) +- Update github actions to run tests on a single module if it is the only file affected by the PR ([#915](https://github.com/ewels/MultiQC/issues/915)) +- Add CI testing for Python 3.10 and 3.11 +- Optimize line-graph generation to remove an n^2 loop ([#1668](https://github.com/ewels/MultiQC/pull/1668)) +- Parsing output file column headers is much faster. + +### MultiQC code cleanup + +- Remove Python 2-3 compatability `from __future__` imports +- Remove unused `#!/usr/bin/env python` hashbangs from module files +- Add new code formatting tool [isort](https://pycqa.github.io/isort/) to standardise the order and formatting of Python module imports +- Add [Pycln](https://hadialqattan.github.io/pycln/#/) pre-commit hook to remove unused imports + +### MultiQC updates + +- Bugfix: Make `config.data_format` work again ([#1722](https://github.com/ewels/MultiQC/issues/1722)) +- Bump minimum version of Jinja2 to `>=3.0.0` ([#1642](https://github.com/ewels/MultiQC/issues/1642)) +- Disable search progress bar if running with `--quiet` or `--no-ansi` ([#1638](https://github.com/ewels/MultiQC/issues/1638)) +- Allow path filters without full paths by trying to prefix analysis dir when filtering ([#1308](https://github.com/ewels/MultiQC/issues/1308)) +- Fix sorting of table columns with text values +- Don't crash if a barplot is given an empty list of categories ([#1540](https://github.com/ewels/MultiQC/issues/1540)) +- New logos! MultiQC is now developed and maintained at [Seqera Labs](https://seqera.io/). Updated logos and email addresses accordingly. + +### New Modules + +- [**Anglerfish**](https://github.com/remiolsen/anglerfish) + - A tool designed to assess pool balancing, contamination and insert sizes of Illumina library dry runs on Oxford Nanopore data. +- [**BBDuk**](https://jgi.doe.gov/data-and-tools/software-tools/bbtools/bb-tools-user-guide/bbduk-guide/) + - Combines most common data-quality-related trimming, filtering, and masking operations via kmers into a single high-performance tool. +- [**Cell Ranger**](https://support.10xgenomics.com/single-cell-gene-expression/software/pipelines/latest/what-is-cell-ranger) + - Works with data from 10X Genomics Chromium. Processes Chromium single cell data to align reads, generate feature-barcode matrices, perform clustering and other secondary analysis, and more. + - New MultiQC module parses Cell Ranger quality reports from VDJ and count analysis +- [**DIAMOND**](https://github.com/bbuchfink/diamond) + - A high-throughput program for aligning DNA reads or protein sequences against a protein reference database. +- [**DRAGEN-FastQC**](https://www.illumina.com/products/by-type/informatics-products/dragen-bio-it-platform.html) + - Illumina Bio-IT Platform that uses FPGA for accelerated primary and secondary analysis + - Finally merged the epic 2.5-year-old pull request, with 3.5k new lines of code. + - Please report any bugs you find! +- [**Filtlong**](https://github.com/rrwick/Filtlong) + - A tool for filtering long reads by quality. +- [**GoPeaks**](https://github.com/maxsonBraunLab/gopeaks) + - GoPeaks is used to call peaks in CUT&TAG/CUT&RUN datasets. +- [**HiFiasm**](https://github.com/chhylp123/hifiasm) + - A haplotype-resolved assembler for accurate Hifi reads +- [**HUMID**](https://github.com/jfjlaros/dedup) + - HUMID is a tool to quickly and easily remove duplicate reads from FastQ files, with or without UMIs. +- [**mOTUs**](https://motu-tool.org/) + - Microbial profiling through marker gene (MG)-based operational taxonomic units (mOTUs) +- [**Nextclade**](https://github.com/nextstrain/nextclade) + - Tool that assigns clades to SARS-CoV-2 samples +- [**Porechop**](https://github.com/rrwick/Porechop) + - A tool for finding and removing adapters from Oxford Nanopore reads +- [**PRINSEQ++**](https://github.com/Adrian-Cantu/PRINSEQ-plus-plus) + - PRINSEQ++ is a C++ of `prinseq-lite.pl` program for filtering, reformating or trimming genomic and metagenomic sequence data. +- [**UMI-tools**](https://umi-tools.readthedocs.io) + - Work with Unique Molecular Identifiers (UMIs) / Random Molecular Tags (RMTs) and single cell RNA-Seq cell barcodes. + +### Module updates + +- **Bcftools stats** + - Bugfix: Do not show empty bcftools stats variant depth plots ([#1777](https://github.com/ewels/MultiQC/pull/1777)) + - Bugfix: Avoid exception when `PSC nMissing` column is not present ([#1832](https://github.com/ewels/MultiQC/issues/1832)) +- **BclConvert** + - Handle single-end read data correctly when setting cluster length instead of always assuming paired-end reads ([#1697](https://github.com/ewels/MultiQC/issues/1697)) + - Handle different R1 and R2 read-lengths correctly instead of assuming they are the same ([#1774](https://github.com/ewels/MultiQC/issues/1774)) + - Handle single-index paired-end data correctly + - Added a config option to enable the creation of barplots with undetermined barcodes (`create_unknown_barcode_barplots` with `False` as default) ([#1709](https://github.com/ewels/MultiQC/pull/1709)) +- **BUSCO** + - Update BUSCO pass/warning/fail scheme to be more clear for users +- **Bustools** + - Show median reads per barcode statistic +- **Custom content** + - Create a report even if there's only Custom Content General Stats there + - Attempt to cooerce line / scatter x-axes into floats so as not to lose labels ([#1242](https://github.com/ewels/MultiQC/issues/1242)) + - Multi-sample line-graph TSV files that have no sample name in row 1 column 1 now use row 1 as x-axis labels ([#1242](https://github.com/ewels/MultiQC/issues/1242)) +- **fastp** + - Add total read count (after filtering) to general stats table ([#1744](https://github.com/ewels/MultiQC/issues/1744)) + - Don't crash for invalid JSON files ([#1652](https://github.com/ewels/MultiQC/issues/1652)) +- **FastQC** + - Report median read-length for fastqc in addition to mean ([#1745](https://github.com/ewels/MultiQC/pull/1745)) +- **Kaiju** + - Don't crash if we don't have any data for the top-5 barplot ([#1540](https://github.com/ewels/MultiQC/issues/1540)) +- **Kallisto** + - Fix `ZeroDivisionError` when a sample has zero reads ([#1746](https://github.com/ewels/MultiQC/issues/1746)) +- **Kraken** + - Fix duplicate heatmap to account for missing taxons ([#1779](https://github.com/ewels/MultiQC/pull/1779)) + - Make heatmap full width + - Handle empty kreports gracefully ([#1637](https://github.com/ewels/MultiQC/issues/1637)) + - Fix regex error with very large numbers of unclassified reads ([#1639](https://github.com/ewels/MultiQC/pull/1639)) +- **malt** + - Fixed division by 0 in malt module ([#1683](https://github.com/ewels/MultiQC/issues/1683)) +- **miRTop** + - Avoid `KeyError` - don't assume all fields present in logs ([#1778](https://github.com/ewels/MultiQC/issues/1778)) +- **Mosdepth** + - Don't pad the General Stats table with zeros for missing data ([#1810](https://github.com/ewels/MultiQC/pull/1810)) +- **Picard** + - HsMetrics: Allow custom columns in General Stats too, with `HsMetrics_genstats_table_cols` and `HsMetrics_genstats_table_cols_hidden` +- **Qualimap** + - Added additional columns in general stats for BamQC results that displays region on-target stats if region bed has been supplied (hidden by default) ([#1798](https://github.com/ewels/MultiQC/pull/1798)) + - Bugfix: Remove General Stats rows for filtered samples ([#1780](https://github.com/ewels/MultiQC/issues/1780)) +- **RSeQC** + - Update `geneBody_coverage` to plot normalized coverages using a similar formula to that used by RSeQC itself ([#1792](https://github.com/ewels/MultiQC/pull/1792)) +- **Sambamba Markdup** + - Catch zero division in sambamba markdup ([#1654](https://github.com/ewels/MultiQC/issues/1654)) +- **Samtools** + - Added additional column for `flagstat` that displays percentage of mapped reads in a bam (hidden by default) ([#1733](https://github.com/ewels/MultiQC/issues/1733)) +- **VEP** + - Don't crash with `ValueError` if there are zero variants ([#1681](https://github.com/ewels/MultiQC/issues/1681)) diff --git a/changelog/multiqc/v1.15.mdx b/changelog/multiqc/v1.15.mdx new file mode 100644 index 000000000..4c52b9ebd --- /dev/null +++ b/changelog/multiqc/v1.15.mdx @@ -0,0 +1,62 @@ +--- +title: MultiQC v1.15 +date: 2023-08-04 +tags: [multiqc] +--- + +## Big speedup in file search step + +This release of MultiQC introduces speed improvements to the file search (~5-7x fold improvement) 🎉 + +One way it does this is by limiting the number of lines loaded by each search pattern. For the vast majority of users, this should have no effect except faster searches. However, in some edge cases **it may introduce some breaking changes**. Hypothetically, for example: + +- If you concatenate log files from multiple tools +- If you have a custom plugin module that we haven't tested + +See the [troubleshooting docs](https://multiqc.info/docs/usage/troubleshooting/#long-log-files) for more information. + +### MultiQC updates + +- Refactor file search for performance improvements ([#1904](https://github.com/ewels/MultiQC/pull/1904)) +- Bump `log_filesize_limit` default (to skip large files in the search) from 10MB to 50MB. +- Table code now tolerates lambda function calls with bad data ([#1739](https://github.com/ewels/MultiQC/issues/1739)) +- Beeswarm plot now saves data to `multiqc_data`, same as tables ([#1861](https://github.com/ewels/MultiQC/issues/1861)) +- Don't print DOI in module if it's set to an empty string. +- Don't sort table headers alphabetically if we don't have an `OrderedDict` - regular dicts are fine in Py3 ([#1866](https://github.com/ewels/MultiQC/issues/1866)) +- New back-end to preview + deploy the new website when the docs are edited. +- Fixed a _lot_ of broken links in the documentation from the new website change in structure. + +### New Modules + +- [**Librarian**](https://github.com/DesmondWillowbrook/Librarian) + - A tool to predict the sequencing library type from the base composition of a supplied FastQ file. + +### Module updates + +- **Cell Ranger** + - Bugfix: avoid multiple `KeyError` exceptions when parsing Cell Ranger 7.x `web_summary.html` ([#1853](https://github.com/ewels/MultiQC/issues/1853), [#1871](https://github.com/ewels/MultiQC/issues/1871)) +- **DRAGEN** + - Restored functionality to show target BED coverage metrics ([#1844](https://github.com/ewels/MultiQC/issues/1844)) + - Update filename pattern in RNA quant metrics ([#1958](https://github.com/ewels/MultiQC/pull/1958)) +- **filtlong** + - Handle reports from locales that use `.` as a thousands separator ([#1843](https://github.com/ewels/MultiQC/issues/1843)) +- **HUMID** + - Fix bug that prevent HUMID stats files from being parsed ([#1856](https://github.com/ewels/MultiQC/issues/1856)) +- **Mosdepth** + - Fix data not written to `mosdepth_cumcov_dist.txt` and `mosdepth_cov_dist.txt` ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Update documentation with new file `{prefix}.mosdepth.summary.txt` ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Fill in missing values for general stats table ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Include mosdepth/summary file paths in `multiqc_sources.txt` ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Enable log switch for Coverage per contig plot ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Fix y-axis scaling for Coverage distribution plot ([#1868](https://github.com/ewels/MultiQC/issues/1868)) + - Handle case of intermediate missing coverage x-values in the `*_dist.txt` file causing a distorted Coverage distribution plot ([#1960](https://github.com/ewels/MultiQC/issues/1960)) +- **Picard** + - WgsMetrics: Fix wrong column label ([#1888](https://github.com/ewels/MultiQC/issues/1888)) + - HsMetrics: Add missing field descriptions ([#1928](https://github.com/ewels/MultiQC/pull/1928)) +- **Porechop** + - Don't render bar graphs if no samples had any adapters trimmed ([#1850](https://github.com/ewels/MultiQC/issues/1850)) + - Added report section listing samples that had no adapters trimmed +- **RSeQC** + - Fix `ZeroDivisionError` error for `bam_stat` results when there are 0 reads ([#1735](https://github.com/ewels/MultiQC/issues/1735)) +- **UMI-tools** + - Fix bug that broke the module with paired-end data ([#1845](https://github.com/ewels/MultiQC/issues/1845)) diff --git a/changelog/multiqc/v1.16.mdx b/changelog/multiqc/v1.16.mdx new file mode 100644 index 000000000..ebaefe7d4 --- /dev/null +++ b/changelog/multiqc/v1.16.mdx @@ -0,0 +1,83 @@ +--- +title: MultiQC v1.16 +date: 2023-09-22 +tags: [multiqc] +--- + +## Highlight: Reporting software versions + +New in v1.16 - software version information can now automatically parsed from log output where available, and added to MultiQC in a standardised manner. It's shown in the MultiQC report next to section headings and in a dedicated report section, as well as being saved to `multiqc_data`. Where version information is not available in logs, it can be submitted manually by using a new special file type with filename pattern `*_mqc_versions.yml`. There's the option of representing groups of versions, useful for a tool that uses sub-tools, or pipelines that want to report version numbers per analysis step. + +There are a handful of new config scopes to control behaviour: `software_versions`, `skip_versions_section`, `disable_version_detection`, `versions_table_group_header`. +See the documentation for more ([writing modules](https://multiqc.info/docs/development/modules/#saving-version-information), [supplying stand-alone](https://multiqc.info/docs/reports/customisation/#listing-software-versions)) + +Huge thanks to [@pontushojer](https://https://github.com/pontushojer) for the contribution ([#1927](https://github.com/ewels/MultiQC/pull/1927)). This idea goes way back to [issue #290](https://github.com/ewels/MultiQC/issues/290), made in 2016! 🎉 + +### MultiQC updates + +- Removed `simplejson` unused dependency ([#1973](https://github.com/ewels/MultiQC/pull/1973)) +- Give config `custom_plot_config` priority over column-specific settings set by modules +- When exporting plots, make a more clear error message for unsupported FastQC dot plot ([#1976](https://github.com/ewels/MultiQC/pull/1976)) +- Fixed parsing of `plot_type: "html"` `data` in json custom content +- Replace deprecated `pkg_resources` +- [Fix](https://github.com/ewels/MultiQC/issues/2032) the module groups configuration for modules where the namespace is passed explicitly to `general_stats_addcols`. Namespace is now always appended to the module name in the general stats ([2037](https://github.com/ewels/MultiQC/pull/2037)). +- Do not call `sys.exit()` in the `multiqc.run()` function, to avoid breaking interactive environments. [#2055](https://github.com/ewels/MultiQC/pull/2055) +- Fixed the DOI exports in `multiqc_data` to include more than just the MultiQC paper ([#2058](https://github.com/ewels/MultiQC/pull/2058)) +- Fix table column color scaling then there are negative numbers ([1869](https://github.com/ewels/MultiQC/issues/1869)) +- Export plots as static images and data in a ZIP archive. Fixes the [issue](https://github.com/ewels/MultiQC/issues/1873) when only 10 plots maximum were downloaded due to the browser limitation. + +### New Modules + +- [**Bakta**](https://github.com/oschwengers/bakta) + - Rapid and standardized annotation of bacterial genomes, MAGs & plasmids. +- [**mapDamage**](https://github.com/ginolhac/mapDamage) + - mapDamage2 is a computational framework written in Python and R, which tracks and quantifies DNA damage patterns among ancient DNA sequencing reads generated by Next-Generation Sequencing platforms. +- [**Sourmash**](https://github.com/sourmash-bio/sourmash) + - Quickly search, compare, and analyze genomic and metagenomic data sets. + +### Module updates + +- **BcfTools** + - Stats: fix parsing multi-sample logs ([#2052](https://github.com/ewels/MultiQC/issues/2052)) +- **Custom content** + - Don't convert sample IDs to floats ([#1883](https://github.com/ewels/MultiQC/issues/1883)) +- **DRAGEN** + - Make DRAGEN module use `fn_clean_exts` instead of hardcoded file names. Fixes working with arbitrary file names ([#1994](https://github.com/ewels/MultiQC/pull/1994)) +- **FastQC**: + - fix `UnicodeDecodeError` when parsing `fastqc_data.txt`: try latin-1 or fail gracefully ([#2024](https://github.com/ewels/MultiQC/issues/2024)) +- **Kaiju**: + - Fix `UnboundLocalError` on outputs when Kanju was run with the `-e` flag ([#2023](https://github.com/ewels/MultiQC/pull/2023)) +- **Kraken** + - Parametrize top-N through config ([#2060](https://github.com/ewels/MultiQC/pull/2060)) + - Fix bug where ranks incorrectly assigned to tabs ([#1766](https://github.com/ewels/MultiQC/issues/1766)). +- **Mosdepth** + - Add X/Y relative coverage plot, analogous to the one in samtools-idxstats ([#1978](https://github.com/ewels/MultiQC/issues/1978)) + - Added the `perchrom_fraction_cutoff` option into the config to help avoid clutter in contig-level plots + - Fix a bug happening when both `region` and `global` coverage histograms for a sample are available (i.e. when mosdepth was run with `--by`, see [mosdepth docs](https://github.com/brentp/mosdepth#usage)). In this case, data was effectively merged. Instead, summarise it separately and add a separate report section for the region-based coverage data. + - Do not fail when all input samples have no coverage ([#2005](https://github.com/ewels/MultiQC/pull/2005)). +- **NanoStat** + - Support new format ([#1997](https://github.com/ewels/MultiQC/pull/1997)). +- **RSeQC** + - Fix `max() arg is an empty sequence` error ([#1985](https://github.com/ewels/MultiQC/issues/1985)) + - Fix division by zero on all-zero input ([#2040](https://github.com/ewels/MultiQC/pull/2040)) +- **Samtools** + - Stats: fix "Percent Mapped" plot when samtools was run with read filtering ([#1972](https://github.com/ewels/MultiQC/pull/1972)) +- **Qualimap** + - BamQC: Include `% On Target` in General Stats table ([#2019](https://github.com/ewels/MultiQC/issues/2019)) +- **WhatsHap** + - Bugfix: ensure that TSV is only split on tab character. Allows sample names with spaces ([#1981](https://github.com/ewels/MultiQC/pull/1981)) + + +## New Contributors +* @gdrosos made their first contribution in https://github.com/ewels/MultiQC/pull/1973 +* @antass made their first contribution in https://github.com/ewels/MultiQC/pull/1991 +* @lindenb made their first contribution in https://github.com/ewels/MultiQC/pull/1972 +* @odcambc made their first contribution in https://github.com/ewels/MultiQC/pull/1968 +* @ehenrion made their first contribution in https://github.com/ewels/MultiQC/pull/1855 +* @louperelo made their first contribution in https://github.com/ewels/MultiQC/pull/1959 +* @Joon-Klaps made their first contribution in https://github.com/ewels/MultiQC/pull/1903 +* @sstrong99 made their first contribution in https://github.com/ewels/MultiQC/pull/1891 +* @taylorreiter made their first contribution in https://github.com/ewels/MultiQC/pull/1812 +* @FerriolCalvet made their first contribution in https://github.com/ewels/MultiQC/pull/2020 + +**Full Changelog**: https://github.com/ewels/MultiQC/compare/v1.15...v1.16 diff --git a/changelog/multiqc/v1.17.mdx b/changelog/multiqc/v1.17.mdx new file mode 100644 index 000000000..8afc29ba2 --- /dev/null +++ b/changelog/multiqc/v1.17.mdx @@ -0,0 +1,56 @@ +--- +title: MultiQC v1.17 +date: 2023-10-17 +tags: [multiqc] +--- + +## The one with the new logo + +Highlights: + +- Introducing the new MultiQC logo! +- Adding support for Python 3.12 and dropping support for Python 3.7 +- New `--require-logs` to fail if expected tool outputs are not found +- Rename `--lint` to `--strict` +- Modules should now use `ModuleNotFoundError` instead of `UserWarning` when no logs are found +- 2 new modules and updates to 9 modules. + +### MultiQC updates + +- Add CI action [changelog.yml](.github%2Fworkflows%2Fchangelog.yml) to populate the changelog from PR titles, triggered by a comment `@multiqc-bot changelog` ([#2025](https://github.com/ewels/MultiQC/pull/2025), [#2102](https://github.com/ewels/MultiQC/pull/2102), [#2115](https://github.com/ewels/MultiQC/pull/2115)) +- Add GitHub Actions bot workflow to fix code linting from a PR comment ([#2082](https://github.com/ewels/MultiQC/pull/2082)) +- Use custom exception type instead of `UserWarning` when no samples are found. ([#2049](https://github.com/ewels/MultiQC/pull/2049)) +- Lint modules for missing `self.add_software_version` ([#2081](https://github.com/ewels/MultiQC/pull/2081)) +- Strict mode: rename `config.lint` to `config.strict`, crash early on module or template error. Add `MULTIQC_STRICT=1` ([#2101](https://github.com/ewels/MultiQC/pull/2101)) +- Matplotlib line plots now respect `xLog: True` and `yLog: True` in config ([#1632](https://github.com/ewels/MultiQC/pull/1632)) +- Fix matplotlib linegraph and bargraph for the case when `xmax` `<` `xmin` in config ([#2124](https://github.com/ewels/MultiQC/pull/2124)) +- Add `--require-logs` flag to error out if requested modules not used ([#2109](https://github.com/ewels/MultiQC/pull/2109)) +- Fixes for python 3.12 + - Replace removed `distutils` ([#2113](https://github.com/ewels/MultiQC/pull/2113)) + - Bundle lzstring ([#2119](https://github.com/ewels/MultiQC/pull/2119)) +- Drop Python 3.6 and 3.7 support, add 3.12 ([#2121](https://github.com/ewels/MultiQC/pull/2121)) +- Just run CI on the oldest + newest supported Python versions ([#2074](https://github.com/ewels/MultiQC/pull/2074)) +- /// New logo +- Set name and anchor for the custom content "module" [#2131](https://github.com/ewels/MultiQC/pull/2131) +- Fix use of `shutil.copytree` when overriding existing template files in `tmp_dir` ([#2133](https://github.com/ewels/MultiQC/pull/2133)) + +### New Modules + +- [**Bracken**](https://ccb.jhu.edu/software/bracken/) + - A highly accurate statistical method that computes the abundance of species in DNA sequences from a metagenomics sample. +- [**Truvari**](https://github.com/ACEnglish/truvari) ([#1751](https://github.com/ewels/MultiQC/pull/1751)) + - Truvari is a toolkit for benchmarking, merging, and annotating structural variants + +### Module updates + +- **Dragen**: make sure all inputs are recorded in multiqc_sources.txt ([#2128](https://github.com/ewels/MultiQC/pull/2128)) +- **Cellranger**: Count submodule updated to parse Antibody Capture summary ([#2118](https://github.com/ewels/MultiQC/pull/2118)) +- **fastp**: parse unescaped sample names with white spaces ([#2108](https://github.com/ewels/MultiQC/pull/2108)) +- **FastQC**: Add top overrepresented sequences table ([#2075](https://github.com/ewels/MultiQC/pull/2075)) +- **HiCPro**: Fix parsing scientific notation in hicpro-ashic. Thanks @Just-Roma ([#2126](https://github.com/ewels/MultiQC/pull/2126)) +- **HTSeq Count**: allow counts files with more than 2 columns ([#2129](https://github.com/ewels/MultiQC/pull/2129)) +- **mosdepth**: fix prioritizing region over global information ([#2106](https://github.com/ewels/MultiQC/pull/2106)) +- **Picard**: Adapt WgsMetrics to parabricks bammetrics outputs ([#2127](https://github.com/ewels/MultiQC/pull/2127)) +- **Picard**: MarkDuplicates: Fix parsing mixed strings/numbers, account for missing trailing `0` ([#2083](https://github.com/ewels/MultiQC/pull/2083), [#2094](https://github.com/ewels/MultiQC/pull/2094)) +- **Samtools**: Add MQ0 reads to the Percent Mapped barplot in Stats submodule ([#2123](https://github.com/ewels/MultiQC/pull/2123)) +- **WhatsHap**: Process truncated input with no ALL chromosome ([#2095](https://github.com/ewels/MultiQC/pull/2095)) diff --git a/changelog/multiqc/v1.18.mdx b/changelog/multiqc/v1.18.mdx new file mode 100644 index 000000000..b71a02758 --- /dev/null +++ b/changelog/multiqc/v1.18.mdx @@ -0,0 +1,68 @@ +--- +title: MultiQC v1.18 +date: 2023-11-17 +tags: [multiqc] +--- + +## Highlights + +### Better configs + +As of this release, you can now set all of your config variables via environment variables! (see [docs](https://multiqc.info/docs/getting_started/config/#config-with-environment-variables)). + +Better still, YAML config files can now use string interpolation to parse environment variables within strings (see [docs](https://multiqc.info/docs/getting_started/config/#referencing-environment-variables-in-yaml-configs)), eg: + +```yaml +report_header_info: + - Contact E-mail: !ENV "${NAME:info}@${DOMAIN:example.com}" +``` + +### Picard refactoring + +In this release, there was a significant refactoring of the Picard module. +It has been generalized for better code sharing with other Picard-based software, like Sentieon and Parabricks. +As a result of this, the standalone Sentieon module was removed: Sentieon QC files will be interpreted directly as Picard QC files. + +If you were using the Sentieon module in your pipelines, make sure to update any places that reference the module name: + +- MultiQC command line (e.g. replace `--module sentieon` with `--module picard`). +- MultiQC configs (e.g. replace `sentieon` with `picard` in options like `run_modules`, `exclude_modules`, `module_order`). +- Downstream code that relies on names of the files in `multiqc_data` or `multiqc_plots` saves (e.g., `multiqc_data/multiqc_sentieon_AlignmentSummaryMetrics.txt` becomes `multiqc_data/multiqc_picard_AlignmentSummaryMetrics.txt`). +- Code that parses data files like `multiqc_data/multiqc_data.json`. +- Custom plugins and templates that rely on HTML anchors (e.g. `#sentieon_aligned_reads` becomes `#picard_AlignmentSummaryMetrics`). +- Also, note that Picard fetches sample names from the commands it finds inside the QC headers (e.g. `# net.sf.picard.analysis.CollectMultipleMetrics INPUT=Szabo_160930_SN583_0215_AC9H20ACXX.bam ...` -> `Szabo_160930_SN583_0215_AC9H20ACXX`), whereas the removed Sentieon module prioritized the QC file names. To revert to the old Sentieon approach, use the [`use_filename_as_sample_name` config flag](https://multiqc.info/docs/getting_started/config/#using-log-filenames-as-sample-names). + +## MultiQC updates + +- Config can be set with environment variables, including env var interpolation ([#2178](https://github.com/ewels/MultiQC/pull/2178)) +- Try find config in `~/.config` or `$XDG_CONFIG_HOME` ([#2183](https://github.com/ewels/MultiQC/pull/2183)) +- Better sample name cleaning with pairs of input filenames ([#2181](https://github.com/ewels/MultiQC/pull/2181)) +- Software versions: allow any string as a version tag ([#2166](https://github.com/ewels/MultiQC/pull/2166)) +- Table columns with non-numeric values and now trigger a linting error if `scale` is set ([#2176](https://github.com/ewels/MultiQC/pull/2176)) +- Stricter config variable typing ([#2178](https://github.com/ewels/MultiQC/pull/2178)) +- Remove `position:absolute` CSS from table values ([#2169](https://github.com/ewels/MultiQC/pull/2169)) +- Fix column sorting in exported TSV files from a matplotlib linegraph plot ([#2143](https://github.com/ewels/MultiQC/pull/2143)) +- Fix custom anchors for kraken ([#2170](https://github.com/ewels/MultiQC/pull/2170)) +- Fix logging spillover bug ([#2174](https://github.com/ewels/MultiQC/pull/2174)) + +## New Modules + +- [**Seqera Platform CLI**](https://github.com/seqeralabs/tower-cli) ([#2151](https://github.com/ewels/MultiQC/pull/2151)) + - Seqera Platform CLI reports statistics generated by the Seqera Platform CLI. +- [**Xenome**](https://github.com/data61/gossamer/blob/master/docs/xenome.md) ([#1860](https://github.com/ewels/MultiQC/pull/1860)) + - A tool for classifying reads from xenograft sources. +- [**xengsort**](https://gitlab.com/genomeinformatics/xengsort) ([#2168](https://github.com/ewels/MultiQC/pull/2168)) + - xengsort is a fast xenograft read sorter based on space-efficient k-mer hashing + +## Module updates + +- **fastp**: add version parsing ([#2159](https://github.com/ewels/MultiQC/pull/2159)) +- **fastp**: correctly parse sample name from `--in1`/`--in2` in bash command. Prefer file name if not `fastp.json`; fallback to file name when error ([#2139](https://github.com/ewels/MultiQC/pull/2139)) +- **Kaiju**: fix `division by zero` error ([#2179](https://github.com/ewels/MultiQC/pull/2179)) +- **Nanostat**: account for both tab and spaces in `v1.41+` search pattern ([#2155](https://github.com/ewels/MultiQC/pull/2155)) +- **Pangolin**: update for v4: add QC Note , update tool versions columns ([#2157](https://github.com/ewels/MultiQC/pull/2157)) +- **Picard**: Generalize to directly support Sentieon and Parabricks outputs ([#2110](https://github.com/ewels/MultiQC/pull/2110)) +- **Sentieon**: Removed the module in favour of directly supporting parsing by the **Picard** module ([#2110](https://github.com/ewels/MultiQC/pull/2110)) + - Note that any code that relies on the module name needs to be updated, e.g. `-m sentieon` will no longer work + - The exported plot and data files will be now be prefixed as `picard` instead of `sentieon`, etc. + - Note that the Sentieon module used to fetch the sample names from the file names by default, and now it follows the Picard module's logic, and prioritizes the commands recorded in the logs. To override, use the `use_filename_as_sample_name` config flag diff --git a/changelog/multiqc/v1.19.mdx b/changelog/multiqc/v1.19.mdx new file mode 100644 index 000000000..83b49a5e1 --- /dev/null +++ b/changelog/multiqc/v1.19.mdx @@ -0,0 +1,51 @@ +--- +title: MultiQC v1.19 +date: 2023-12-18 +tags: [multiqc] +--- + +## Highlights + +An early Christmas present 🎁 Happy holidays everyone! 🎄 + +This release is mostly bugfixes and minor additions, whilst we lay the groundwork for some bigger updates coming in the new year. Still, there are plenty of goodies in here. Enjoy! + +See the full changes in this release here: https://github.com/ewels/MultiQC/compare/v1.18...v1.19 + +## MultiQC updates + +- Add missing table `id` in DRAGEN modules, and require `id` in plot configs in strict mode ([#2228](https://github.com/ewels/MultiQC/pull/2228)) +- Config `table_columns_visible` and `table_columns_name`: support flat config and `table_id` as a group ([#2191](https://github.com/ewels/MultiQC/pull/2191)) +- Add `sort_samples: false` config option for bar graphs ([#2210](https://github.com/ewels/MultiQC/pull/2210)) +- Upgrade the jQuery tablesorter plugin to v2 ([#1666](https://github.com/ewels/MultiQC/pull/1666)) +- Refactor pre-Python-3.6 code, prefer f-strings over `.format()` calls ([#2224](https://github.com/ewels/MultiQC/pull/2224)) +- Allow specifying default sort columns for tables with `defaultsort` ([#1667](https://github.com/ewels/MultiQC/pull/1667)) +- Create CODE_OF_CONDUCT.md ([#2195](https://github.com/ewels/MultiQC/pull/2195)) +- Add `.cram` to sample name cleaning defaults ([#2209](https://github.com/ewels/MultiQC/pull/2209)) + +## MultiQC bug fixes + +- Re-add `run` into the `multiqc` namespace ([#2202](https://github.com/ewels/MultiQC/pull/2202)) +- Fix the `"square": True` flag to scatter plot to actually make the plot square ([#2189](https://github.com/ewels/MultiQC/pull/2189)) +- Fix running with the `--no-report` flag ([#2212](https://github.com/ewels/MultiQC/pull/2212)) +- Fix guessing custom content plot type: do not assume first row of a bar plot data are sample names ([#2208](https://github.com/ewels/MultiQC/pull/2208)) +- Fix detection of changed specific module in Changelog CI ([#2234](https://github.com/ewels/MultiQC/pull/2234)) + +## Module updates + +- **BCLConvert**: fix mean quality, fix count-per-lane bar plot ([#2197](https://github.com/ewels/MultiQC/pull/2197)) +- **deepTools**: handle missing data in `plotProfile` ([#2229](https://github.com/ewels/MultiQC/pull/2229)) +- **Fastp**: search content instead of file name ([#2213](https://github.com/ewels/MultiQC/pull/2213)) +- **GATK**: square the `BaseRecalibrator` scatter plot ([#2189](https://github.com/ewels/MultiQC/pull/2189)) +- **HiC-Pro**: add missing search patterns and better handling of missing data ([#2233](https://github.com/ewels/MultiQC/pull/2233)) +- **Kraken**: fix `UnboundLocalError` ([#2230](https://github.com/ewels/MultiQC/pull/2230)) +- **Kraken**: fixed column keys in genstats ([#2205](https://github.com/ewels/MultiQC/pull/2205)) +- **QualiMap**: fix `BamQC` for global-only stats ([#2207](https://github.com/ewels/MultiQC/pull/2207)) +- **Picard**: add more search patterns for `MarkDuplicates`, including `MarkDuplicatesSpark` ([#2226](https://github.com/ewels/MultiQC/pull/2226)) +- **Salmon**: add `library_types`, `compatible_fragment_ratio`, `strand_mapping_bias` to the general stats table ([#1485](https://github.com/ewels/MultiQC/pull/1485)) + +## New Contributors +* @gsmashd made their first contribution in https://github.com/ewels/MultiQC/pull/2205 +* @kclem made their first contribution in https://github.com/ewels/MultiQC/pull/2235 + +**Full Changelog**: https://github.com/ewels/MultiQC/compare/v1.18...v1.19 diff --git a/changelog/multiqc/v1.2.mdx b/changelog/multiqc/v1.2.mdx new file mode 100644 index 000000000..5fb25673f --- /dev/null +++ b/changelog/multiqc/v1.2.mdx @@ -0,0 +1,93 @@ +--- +title: MultiQC v1.2 +date: 2017-08-16 +tags: [multiqc] +--- + + +#### CodeFest 2017 Contributions +We had a fantastic group effort on MultiQC at the [2017 BOSC CodeFest](https://www.open-bio.org/wiki/Codefest_2017). +Many thanks to those involved! + +#### New Modules: +* [**AfterQC**](https://github.com/OpenGene/AfterQC) - New module! + * Added parsing of the _AfterQC_ json file data, with a plot of filtered reads. + * Work by [@raonyguimaraes](https://github.com/raonyguimaraes) +* [**bcl2fastq**](https://support.illumina.com/downloads/bcl2fastq-conversion-software-v2-18.html) + * bcl2fastq can be used to both demultiplex data and convert BCL files to FASTQ file formats for downstream analysis + * New module parses JSON output from recent versions and summarises some key statistics from the demultiplexing process. + * Work by [@iimog](https://github.com/iimog) (with a little help from [@tbooth](https://github.com/tbooth) and [@ewels](https://github.com/ewels)) +* [**leeHom**](https://github.com/grenaud/leeHom) + * leeHom is a program for the Bayesian reconstruction of ancient DNA +* [**VCFTools**](https://vcftools.github.io) + * Added initial support for VCFTools `relatedness2` + * Added support for VCFTools `TsTv-by-count` `TsTv-by-qual` `TsTv-summary` + * Module written by [@mwhamgenomics](https://github.com/mwhamgenomics) + +#### Module updates: +* **FastQ Screen** + * Gracefully handle missing data from very old FastQ Screen versions. +* **RNA-SeQC** + * Add new transcript-associated reads plot. +* **Picard** + * New submodule to handle output from `TargetedPcrMetrics` +* **Prokka** + * Added parsing of the `# CRISPR arrays` data from Prokka when available ([@asetGem](https://github.com/asetGem)) +* **Qualimap** + * Some code refactoring to radically improve performance and run times, especially with high coverage datasets. + * Fixed bug where _Cumulative coverage genome fraction_ plot could be truncated. + +#### New MultiQC Features: +* New module help text + * Lots of additional help text was written to make MultiQC report plots easier to interpret. + * Updated modules: + * Bowtie + * Bowtie 2 + * Prokka + * Qualimap + * SnpEff + * Elite team of help-writers: + * [@tabwalsh](https://github.com/tabwalsh) + * [@ddesvillechabrol](https://github.com/tabwalsh) + * [@asetGem](https://github.com/asetGem) +* New config option `section_comments` allows you to add custom comments above specific sections in the report +* New `--tags` and `--view_tags` command line options + * Modules can now be given tags (keywords) and filtered by those. So running `--tags RNA` will only run MultiQC modules related to RNA analysis. + * Work by [@Hammarn](https://github.com/Hammarn) +* Back-end configuration options to specify the order of table columns + * Modules and user configs can set priorities for columns to customise where they are displayed + * Work by [@tbooth](https://github.com/tbooth) +* Added framework for proper unit testing + * Previous start on unit tests tidied up, new blank template and tests for the `clean_sample_name` functionality. + * Added to Travis and Appveyor for continuous integration testing. + * Work by [@tbooth](https://github.com/tbooth) +* Bug fixes and refactoring of report configuration saving / loading + * Discovered and fixed a bug where a report config could only be loaded once + * Work by [@DennisSchwartz](https://github.com/DennisSchwartz) +* Table column row headers (sample names) can now be numeric-only. + * Work by [@iimog](https://github.com/iimog) +* Improved sample name cleaning functionality + * Added option `regex_keep` to clean filenames by _keeping_ the matching part of a pattern + * Work by [@robinandeer](https://github.com/robinandeer) +* Handle error when invalid regexes are given in reports + * Now have a nice toast error warning you and the invalid regexes are highlighted + * Previously this just crashed the whole report without any warning + * Work by [@robinandeer](https://github.com/robinandeer) +* Command line option `--dirs-depth` now sets `-d` to `True` (so now works even if `-d` isn't also specified). +* New config option `config.data_dump_file` to export as much data as possible to `multiqc_data/multiqc_data.json` +* New code to send exported JSON data to a a web server + * This is in preparation for the upcoming MegaQC project. Stay tuned! + +#### Bug Fixes: +* Specifying multiple config files with `-c`/`--config` now works as expected + * Previously this would only read the last specified +* Fixed table rendering bug that affected Chrome v60 and IE7-11 + * Table cell background bars weren't showing up. Updated CSS to get around this rendering error. +* HTML ID cleanup now properly cleans strings so that they work with jQuery as expected. +* Made bar graph sample highlighting work properly again +* Config `custom_logo` paths can now be relative to the config file (or absolute as before) +* Report doesn't keep annoyingly telling you that toolbox changes haven't been applied + * Now uses more subtle _toasts_ and only when you close the toolbox (not every click). +* Switching report toolbox options to regex mode now enables the _Apply_ button as it should. +* Sorting table columns with certain suffixes (eg. `13X`) no works properly (numerically) +* Fixed minor bug in line plot data smoothing (now works with unsorted keys) diff --git a/changelog/multiqc/v1.20.mdx b/changelog/multiqc/v1.20.mdx new file mode 100644 index 000000000..f7adc72b1 --- /dev/null +++ b/changelog/multiqc/v1.20.mdx @@ -0,0 +1,97 @@ +--- +title: MultiQC v1.20 +date: 2024-02-12 +tags: [multiqc] +--- + +## Highlights + +### New plotting library + +MultiQC v1.20 comes with totally new plotting code for MultiQC reports. This is a huge change to the report output. We've done our best to maintain feature parity with the previous plotting code, but please do let us know if you spot any bugs or changes in behaviour by creating a GitHub issue. + +This change comes with many improvements and new features, and paves the way for more in the future. To find out more, read the [associated blog post](https://seqera.io/blog/multiqc-plotly/). + +For now, you can revert to the previous plotting code by using the `highcharts` report template (`multiqc --template highcharts`). This will be removed in v1.21. + +Note that there are several plotting configuration options which have been removed: + +- `click_func` +- `cursor` +- `tt_percentages` (use `tt_suffix: "%"`) +- Bar plot: + - `use_legend` (automatically hidden if there is only 1 category) +- Line plot: + - `labelSize` + - `xDecimals`, `yDecimals` (automatic if all values can be cast to int) + - `xLabelFormat`, `yLabelFormat` (use `tt_label`) + - `pointFormat` +- Heatmap: + - `datalabel_colour` + - `borderWidth` + +### Moved GitHub and docker repositories + +The v1.20 release is also the first release we've had since we moved the MultiQC repositories. Please note that the code is now at [MultiQC/MultiQC](https://github.com/MultiQC/MultiQC) (formerly [ewels/MultiQC](https://github.com/ewels/MultiQC)) and the same for the Docker repository. The GitHub repo should automatically redirect, but it's still good to update any references you may have. + +## MultiQC updates + +- Support Plotly as a new backend for plots ([#2079](https://github.com/MultiQC/MultiQC/pull/2079)) + - The default template now uses Plotly for all plots + - Added a new plot type `violin` (replaces `beeswarm`) + - Moved legacy Highcharts/Matplotlib code under an optional template `highcharts` + ([#2292](https://github.com/MultiQC/MultiQC/pull/2292)) +- Move GitHub repository to `MultiQC` organisation ([#2243](https://github.com/MultiQC/MultiQC/pull/2243)) +- Update all GitHub actions to their latest versions ([#2242](https://github.com/ewels/MultiQC/pull/2242)) +- Update docs to work with Astro 4 ([#2256](https://github.com/MultiQC/MultiQC/pull/2256)) +- Remove unused dependency on `future` library ([#2258](https://github.com/MultiQC/MultiQC/pull/2258)) +- Fix incorrect scale IDs caught by linting ([#2272](https://github.com/MultiQC/MultiQC/pull/2272)) +- Docs: fix missing `v` prefix in docker image tags ([#2273](https://github.com/MultiQC/MultiQC/pull/2273)) +- Unicode file reading errors: attempt to skip non-unicode characters ([#2275](https://github.com/MultiQC/MultiQC/pull/2275)) +- Heatmap: check if value is numeric when calculating min and max ([#2276](https://github.com/MultiQC/MultiQC/pull/2276)) +- Add `filesearch_file_shared` config option, remove unnecessary per-module `shared` flags in search patterns ([#2227](https://github.com/ewels/MultiQC/pull/2227)) +- Use alternative method to walk directory using pathlib ([#2277](https://github.com/MultiQC/MultiQC/pull/2277)) +- Export `config.output_dir` in MegaQC JSON ([#2287](https://github.com/MultiQC/MultiQC/pull/2287)) +- Drop support for module tags ([#2278](https://github.com/MultiQC/MultiQC/pull/2278)) +- Pin `Pillow` package, wrap add_logo in try-except ([#2312](https://github.com/MultiQC/MultiQC/pull/2312)) +- Custom content: support multiple datasets ([#2291](https://github.com/MultiQC/MultiQC/pull/2291)) +- Configuration: fix reading config.output_fn_name and --filename ([#2314](https://github.com/MultiQC/MultiQC/pull/2314)) + +## New modules + +- [**Bamdst**](https://https://github.com/shiquan/bamdst) ([#2161](https://github.com/MultiQC/MultiQC/pull/2161)) + - Bamdst is a lightweight tool to stat the depth coverage of target regions of bam file(s). +- [**MetaPhlAn**](https://github.com/biobakery/MetaPhlAn) ([#2262](https://github.com/MultiQC/MultiQC/pull/2262)) + - MetaPhlAn is a computational tool for profiling the composition of microbial communities from metagenomic shotgun sequencing data. +- [**MEGAHIT**](https://github.com/voutcn/megahit) ([#2222](https://github.com/ewels/MultiQC/pull/2222)) + - MEGAHIT is an ultra-fast and memory-efficient NGS assembler +- [**Nonpareil**](https://github.com/lmrodriguezr/nonpareil) ([#2215](https://github.com/MultiQC/MultiQC/pull/2215)) + - Estimate metagenomic coverage and sequence diversity. + +## Module updates + +- **Bcftools**: order variant depths plot categories ([#2289](https://github.com/MultiQC/MultiQC/pull/2289)) +- **Bcftools**: add missing `self.ignore_samples` in stats ([#2288](https://github.com/MultiQC/MultiQC/pull/2288)) +- **BCL Convert**: add index, project names to sample statistics and calculate mean quality for lane statistics. ([#2261](https://github.com/MultiQC/MultiQC/pull/2261)) +- **BCL Convert**: fix duplicated `yield` for 3.9.3+ when the yield is provided explicitly in Quality_Metrics ([#2253](https://github.com/MultiQC/MultiQC/pull/2253)) +- **BCL Convert**: handle samples with zero yield ([#2297](https://github.com/MultiQC/MultiQC/pull/2297)) +- **Bismark**: fix old link in Bismark docs ([#2252](https://github.com/MultiQC/MultiQC/pull/2252)) +- **Bismark**: fix old link in docs ([#2252](https://github.com/MultiQC/MultiQC/pull/2252)) +- **Cutadapt**: support JSON format ([#2281](https://github.com/MultiQC/MultiQC/pull/2281)) +- **HiFiasm**: account for lines with no asterisk ([#2268](https://github.com/MultiQC/MultiQC/pull/2268)) +- **HUMID**: add cluster statistics ([#2265](https://github.com/MultiQC/MultiQC/pull/2265)) +- **mosdepth**: add additional summaries to general stats #2257 ([#2257](https://github.com/MultiQC/MultiQC/pull/2257)) +- **Picard**: fix using multiple times in report: do not pass `module.anchor` to `self.find_log_files` ([#2255](https://github.com/MultiQC/MultiQC/pull/2255)) +- **QualiMap**: address NBSP as thousands separators ([#2282](https://github.com/MultiQC/MultiQC/pull/2282)) +- **Seqera Platform CLI**: updates for v0.9.2 ([#2248](https://github.com/MultiQC/MultiQC/pull/2248)) +- **Seqera Platform CLI**: handle failed tasks ([#2286](https://github.com/MultiQC/MultiQC/pull/2286)) + +## New Contributors +* @a-detiste made their first contribution in https://github.com/MultiQC/MultiQC/pull/2258 +* @mbeavitt made their first contribution in https://github.com/MultiQC/MultiQC/pull/2268 +* @almahans made their first contribution in https://github.com/MultiQC/MultiQC/pull/2262 +* @kmlhpk made their first contribution in https://github.com/MultiQC/MultiQC/pull/2273 +* @studioph made their first contribution in https://github.com/MultiQC/MultiQC/pull/2277 +* @vsmalladi made their first contribution in https://github.com/MultiQC/MultiQC/pull/1503 + +**Full Changelog**: https://github.com/MultiQC/MultiQC/compare/v1.19...v1.20 diff --git a/changelog/multiqc/v1.21.mdx b/changelog/multiqc/v1.21.mdx new file mode 100644 index 000000000..68cc4bad6 --- /dev/null +++ b/changelog/multiqc/v1.21.mdx @@ -0,0 +1,129 @@ +--- +title: MultiQC v1.21 +date: 2024-02-28 +tags: [multiqc] +--- + +## Highlights + +### Box plot + +Added a new plot type: box plot. It's useful to visualise a distribution when you have a set of values for each sample. + +```py +from multiqc.plots import box +self.add_section( + ..., + plot=box.plot( + { + "sample 1": [4506, 4326, 3137, 1563, 1730, 3254, 2259, 3670, 2719, ...], + "sample 2": [2145, 2011, 3368, 2132, 1673, 1993, 6635, 1635, 4984, ...], + "sample 3": [1560, 1845, 3247, 1701, 2829, 2775, 3179, 1724, 1828, ...], + }, + pconfig={ + "title": "Iso-Seq: Insert Length", + }, + ) +) +``` + + + +Note the difference with the violin plot: the box plot visualises the distributions of many values within one sample, whereas the violin plot shows the distribution of one metric across many samples. + +### pyproject.toml + +The `setup.py` file has been superseded by `pyproject.toml` for the build configuration. +Note that now for new modules, an entry point should be added to `pyproject.toml` instead of `setup.py`, e.g.: + +```toml +[project.entry-points."multiqc.modules.v1"] +afterqc = "multiqc.modules.afterqc:MultiqcModule" +``` + +### Heatmap + +The heatmap plot now supports passing a dict as input data, and also supports a `zlab` +parameter to set the label for the z-axis: + +```py +from multiqc.plots import heatmap +self.add_section( + ..., + plot=heatmap.plot( + { + "sample 1": {"sample 2": 0, "sample 3": 1}, + "sample 2": {"sample 1": 0, "sample 3": 0}, + "sample 3": {"sample 1": 1, "sample 2": 0, "sample 3": 1}, + }, + pconfig={ + "title": "Sample comparison", + "zlab": "Match", + }, + ) +) +``` + +## MultiQC updates + +- New plot type: box plot ([#2358](https://github.com/MultiQC/MultiQC/pull/2358)) +- Add "Export to CSV" button for tables ([#2394](https://github.com/MultiQC/MultiQC/pull/2394)) +- Replace `setup.py` with `pyproject.toml` ([#2353](https://github.com/MultiQC/MultiQC/pull/2353)) +- Heatmap: allow a dict dicts of data ([#2386](https://github.com/MultiQC/MultiQC/pull/2386)) +- Heatmap: add `zlab` config parameter. Show `xlab`, `ylab`, `zlab` in tooltip ([#2387](https://github.com/MultiQC/MultiQC/pull/2387)) +- Warn if `run_modules` contains a non-existent module ([#2322](https://github.com/MultiQC/MultiQC/pull/2322)) +- Catch non-hashable values (dicts, lists) passed as a table cell value ([#2348](https://github.com/MultiQC/MultiQC/pull/2348)) +- Always create JSON even when MegaQC upload is disabled ([#2330](https://github.com/MultiQC/MultiQC/pull/2330)) +- Use generic font family for Plotly ([#2368](https://github.com/MultiQC/MultiQC/pull/2368)) +- Use a padded span with `nowrap` instead of ` ` before suffixes in table cells ([#2395](https://github.com/MultiQC/MultiQC/pull/2395)) +- Refactor: fix unescaped regex strings ([#2384](https://github.com/MultiQC/MultiQC/pull/2384)) + +Fixes: + +- Pin the required Plotly version and add a runtime version check ([#2325](https://github.com/MultiQC/MultiQC/pull/2325)) +- Bar plot: preserve the sample order ([#2339](https://github.com/MultiQC/MultiQC/pull/2339)) +- Bar plot: fix inner gap in group mode ([#2321](https://github.com/MultiQC/MultiQC/pull/2321)) +- Violin: filter `Inf` values ([#2380](https://github.com/MultiQC/MultiQC/pull/2380)) +- Table: Fix use of the `no_violin` (ex-`no_beeswarm`) table config flag ([#2376](https://github.com/MultiQC/MultiQC/pull/2376)) +- Heatmap: prevent from parsing numerical sample names ([#2349](https://github.com/MultiQC/MultiQC/pull/2349)) +- Work around call of `full_figure_for_development` to avoid Kaleido errors ([#2359](https://github.com/MultiQC/MultiQC/pull/2359)) +- Auto-generate plot `id` when `pconfig=None` ([#2337](https://github.com/MultiQC/MultiQC/pull/2337)) +- Fix: infinite `dmax` or `dmin` fail JSON dump load in JavaScript ([#2354](https://github.com/MultiQC/MultiQC/pull/2354)) +- Fix: dump `pconfig` for MegaQC ([#2344](https://github.com/MultiQC/MultiQC/pull/2344)) + +## New modules + +- [**IsoSeq**](https://github.com/PacificBiosciences/IsoSeq) + - Iso-Seq contains the newest tools to identify transcripts in PacBio single-molecule sequencing data (HiFi reads). `cluster` and `refine` commands are supported. +- [**Space Ranger**](https://support.10xgenomics.com/spatial-gene-expression/software/pipelines/latest/what-is-space-ranger) + - Works with data from 10X Genomics Visium. Processes sequencing reads and images created using + the 10x Visium platform to generate count matrices with spatial information. + - New MultiQC module parses Space Ranger quality reports. + +## Module updates + +- **bcl2fastq**: fix the top undetermined barcodes plot ([#2340](https://github.com/MultiQC/MultiQC/pull/2340)) +- **DRAGEN**: add few coverage metrics in general stats ([#2341](https://github.com/MultiQC/MultiQC/pull/2341)) +- **DRAGEN**: fix showing the number of found samples ([#2347](https://github.com/MultiQC/MultiQC/pull/2347)) +- **DRAGEN**: support `gvcf_metrics` ([#2327](https://github.com/MultiQC/MultiQC/pull/2327)) +- **fastp**: fix detection of JSON files ([#2334](https://github.com/MultiQC/MultiQC/pull/2334)) +- **HTSeq Count**: robust file reading loop, ignore `.parquet` files ([#2364](https://github.com/MultiQC/MultiQC/pull/2364)) +- **Illumina InterOp Statistics**: do not set `'scale': False` as a default ([#2350](https://github.com/MultiQC/MultiQC/pull/2350)) +- **mosdepth**: fix regression in showing general stats ([#2346](https://github.com/MultiQC/MultiQC/pull/2346)) +- **Picard**: Crosscheck Fingerprints updates ([#2388](https://github.com/MultiQC/MultiQC/pull/2388)) + - add a heatmap for LOD scores besides a table + - if too many pairs in table, skip those with `Expected` status + - use the `warn` status for `Inconclusive` + - add a separate sample-wise table instead of general stats + - sort tables by status, not by sample name + - add a column "Best match" and "Best match LOD" in tables + - hide the LOD Threshold column +- **PURPLE**: support v4.0.1 output without `version` column ([#2366](https://github.com/MultiQC/MultiQC/pull/2366)) +- **Samtools**: support new `coverage` command ([#2356](https://github.com/MultiQC/MultiQC/pull/2356)) +- **UMI-tools**: support new `extract` command ([#2296](https://github.com/MultiQC/MultiQC/pull/2296)) +- **Whatshap**: make robust when a stdout is appended to TSV ([#2361](https://github.com/MultiQC/MultiQC/pull/2361)) + +## New Contributors +* @grst made their first contribution in https://github.com/MultiQC/MultiQC/pull/1945 + +**Full Changelog**: https://github.com/MultiQC/MultiQC/compare/v1.20...v1.21 diff --git a/changelog/multiqc/v1.22.1.mdx b/changelog/multiqc/v1.22.1.mdx new file mode 100644 index 000000000..ac15ade27 --- /dev/null +++ b/changelog/multiqc/v1.22.1.mdx @@ -0,0 +1,9 @@ +--- +title: MultiQC v1.22.1 +date: 2024-05-17 +tags: [multiqc] +--- + +### Fix running as a Nextflow job + +This bug fix release addresses the file search problem when MultiQC is executed as a typical Nextflow job. See [#2575](https://github.com/MultiQC/MultiQC/pull/2575) for detail. diff --git a/changelog/multiqc/v1.22.2.mdx b/changelog/multiqc/v1.22.2.mdx new file mode 100644 index 000000000..d8c593796 --- /dev/null +++ b/changelog/multiqc/v1.22.2.mdx @@ -0,0 +1,32 @@ +--- +title: MultiQC v1.22.2 +date: 2024-05-31 +tags: [multiqc] +--- + +### Bug fix release. Two main issues are fixed: + +- Fixed running the same module twice with `path_filters` (e.g. trimmed vs. raw FastQC), +- The raw data `report_saved_raw_data` is re-added in multiqc_data.json by default. + +#### MultiQC fixes + +- Fix running the same module multiple times in the report (e.g. trimmed vs. raw FastQC) ([#2592](https://github.com/MultiQC/MultiQC/pull/2592)) +- Preserve `report_saved_raw_data` in multiqc_data.json by keeping `preserve_module_raw_data: false` by default ([#2591](https://github.com/MultiQC/MultiQC/pull/2591)) +- Table headers: do not set namespace to `None` when there is a single namespace ([#2590](https://github.com/MultiQC/MultiQC/pull/2590)) +- Re-enable falling back to flat plots for large datasets ([#2580](https://github.com/MultiQC/MultiQC/pull/2580)) +- Reset in `multiqc.run(*)` to allow running it twice interactively ([#2598](https://github.com/MultiQC/MultiQC/pull/2598)) +- Fix scatter plot in `--flat` mode when there are categorical axes ([#2600](https://github.com/MultiQC/MultiQC/pull/2600)) +- Fix hiding table column with all empty values in custom content ([#2599](https://github.com/MultiQC/MultiQC/pull/2599)) +- Table "Copy" button: include headers ([#2594](https://github.com/MultiQC/MultiQC/pull/2594)) + +#### Module fixes and updates + +- **QUAST** + - Underscore attributes captured by lambdas to avoid wiping them after the module is finished ([#2581](https://github.com/MultiQC/MultiQC/pull/2581)) +- **Cell Ranger** + - Handle missing `vdj_annotation` and `vdj_enrichment` sections ([#2579](https://github.com/MultiQC/MultiQC/pull/2579)) +- **fgbio** + - Fix links in fgbio.md ([#2586](https://github.com/MultiQC/MultiQC/pull/2586)) +- **Custom content** + - Support DOI for custom content ([#2582](https://github.com/MultiQC/MultiQC/pull/2582)) diff --git a/changelog/multiqc/v1.22.3.mdx b/changelog/multiqc/v1.22.3.mdx new file mode 100644 index 000000000..989efcf9b --- /dev/null +++ b/changelog/multiqc/v1.22.3.mdx @@ -0,0 +1,67 @@ +--- +title: MultiQC v1.22.3 +date: 2024-06-22 +tags: [multiqc] +--- + +Contains fixes of multiple bugs collected after the last release along with a few minor improvements. + +### MultiQC fixes + +- Fix the `re_contents` search patterns when pattern is found in the middle of the file. Fixes finding logs from several Picard submodules, like `CollectRnaSeqMetrics` and `CollectWgsMetrics` in some cases ([#2610](https://github.com/MultiQC/MultiQC/pull/2610)) +- Fixes the `run_modules` option use when the module anchor doesn't match the module entry point ID (e.g. `DRAGEN` and `dragen`) ([#2633](https://github.com/MultiQC/MultiQC/pull/2633)) +- Fix use of custom search patterns for custom content ([#2647](https://github.com/MultiQC/MultiQC/pull/2647)) +- Fix plot export with `export_plots: true` or `--export` ([#2637](https://github.com/MultiQC/MultiQC/pull/2637)) +- Correctly handle old-style `label` sections in `x_lines` or `y_lines` in line plot configs ([#2648](https://github.com/MultiQC/MultiQC/pull/2648)) +- Fix disabling `sort_rows` in custom content by subclassing `TableConfig` from `ValidatedConfig` and use deprecated ([#2604](https://github.com/MultiQC/MultiQC/pull/2604)) +- When user provides a search pattern dictionary in config, recursively update instead of replacing ([#2620](https://github.com/MultiQC/MultiQC/pull/2620)) +- Fix config update when dict replaced with list, e.g. a `search_patterns` item is a list that's replaced with a dict (https://github.com/MultiQC/MultiQC/commit/c388178bb6d9f143c6f8e8b0146647a067021ea4) + +### MultiQC updates + +- Add unit tests for core and some modules (see `picard` or `samtools`), as well as `codecov` report ([#2624](https://github.com/MultiQC/MultiQC/pull/2624)) + - Now MultiQC checks if every module does something productive with the provided test data in `test-data`. + - For modules with many submodules (picard, dragen), additionally check if every submodule parses the expected number of samples from `test-data` files. + - Users can put module tests in `test` subfolders, e.g. https://github.com/MultiQC/MultiQC/tree/main/multiqc/modules/picard/tests + - Use `pytest` for all core unit tests ([#2623](https://github.com/MultiQC/MultiQC/pull/2623)) + - Move unit tests from the `test-data` repo into `tests` folder ([#2622](https://github.com/MultiQC/MultiQC/pull/2622)) +- Plot config validation: + - Validate line plot `x_lines`, `x_bands`, etc. with a Pydantic model, including `label` subsections ([#2648](https://github.com/MultiQC/MultiQC/pull/2648)) + - Validate line plot series and `extra_series` with a Pydantic model ([#2573](https://github.com/MultiQC/MultiQC/pull/2573)) + - Validate table config ([#2604](https://github.com/MultiQC/MultiQC/pull/2604)) + - Make the "unrecognised field" error a warning + - Rename deprecated plot config fields in internal modules ([#2636](https://github.com/MultiQC/MultiQC/pull/2636)) +- Show progress bar for exporting flat plot images ([#2639](https://github.com/MultiQC/MultiQC/pull/2639)) +- Better error message for incorrect `run_modules` ([#2635](https://github.com/MultiQC/MultiQC/pull/2635)) +- Increase flat plots sample number threshold to 1000 ([#2615](https://github.com/MultiQC/MultiQC/pull/2615)) +- Small speed-up of the line block iterator ([#2588](https://github.com/MultiQC/MultiQC/pull/2588)) +- Update README logos for better compatibility ([#2603](https://github.com/MultiQC/MultiQC/pull/2603)) +- Docs: don't use raw markdown links ([#2642](https://github.com/MultiQC/MultiQC/pull/2642)) +- Allow to override `showlegend` for line config plots. Default to not-show for large datasets to avoid bloated legends ([#2615](https://github.com/MultiQC/MultiQC/pull/2615)) +- Show error message if failed to parse custom content header (https://github.com/MultiQC/MultiQC/commit/d736846a0c23410243f80b2bdca984363211ffc3) +- Load every found config file once https://github.com/MultiQC/MultiQC/commit/422b39bc787720cefea81a85dabbf6411b3421ac + +### Module fixes and updates + +- **Picard** + - Fix finding `CollectRnaSeqMetrics` and `CollectWgsMetrics` logs by fixing the `re_contents` search patterns ([#2610](https://github.com/MultiQC/MultiQC/pull/2610)) +- **biobambam2** + - Fix parsing `markdups` logs +- **DRAGEN** + - Coverage histograms: fix duplicated label suffix ([#2619](https://github.com/MultiQC/MultiQC/pull/2619)) + - Fix the `gc_metrics` submodule ([#2629](https://github.com/MultiQC/MultiQC/pull/2629)) + - `vc_metrics`: pre-filter numbers can be zero ([#2618](https://github.com/MultiQC/MultiQC/pull/2618)) +- **FastQC** + - Default to `showlegend: false`, as we don't distinguish the sample colors, unless `fastqc_config: status_checks: false'` is set ([#2615](https://github.com/MultiQC/MultiQC/pull/2615)) +- **BBTools** + - Fix incorrect calculation of % Q30 Bases ([#2628](https://github.com/MultiQC/MultiQC/pull/2628)) +- **Samtools** + - `markdup`: resolve inconsistent non-optical pair duplicate variable name in samtools markdup module ([#2626](https://github.com/MultiQC/MultiQC/pull/2626)) +- **NanoStat** + - Support different `Q` cutoffs ([#2645](https://github.com/MultiQC/MultiQC/pull/2645)) +- **Salmon** + - Fix ignored parsed `library_types` when its type is list ([#2617](https://github.com/MultiQC/MultiQC/pull/2617)) +- **UMI-tools** + - Improve `extract` plots ([#2614](https://github.com/MultiQC/MultiQC/pull/2614)) +- **BCL Convert** + - Fix 'pecent' typo ([#2612](https://github.com/MultiQC/MultiQC/pull/2612)) diff --git a/changelog/multiqc/v1.22.mdx b/changelog/multiqc/v1.22.mdx new file mode 100644 index 000000000..bc41f2b14 --- /dev/null +++ b/changelog/multiqc/v1.22.mdx @@ -0,0 +1,130 @@ +--- +title: MultiQC v1.22 +date: 2024-05-15 +tags: [multiqc] +--- + +## Highlights - notebooks and performance + +Version 1.22 brings some major behind-the-scenes refactoring to MultiQC. This unlocks a number of new features, such as the ability to use MultiQC as a Python library in scripts / notebooks, and run-time validation of plot config attributes. + +This release also introduces some huge performance improvements thanks to [@rhpvorderman](https://github.com/rhpvorderman). +Compared to v1.21, a typical v1.22 run is **53% faster** and has a **6x smaller peak-memory footprint** - well worth updating! 🏃🏻‍♂️ 💨 + +Finally, support for the depreciated HighCharts plotting library is fully removed in v1.22, bringing to a close a long standing project to migrate to Plotly. + +For more information, please see the upcoming MultiQC release blog article on the Seqera website: https://seqera.io/blog/ + +### MultiQC updates + +- Remove the `highcharts` template and Highcharts and Matplotlib dependencies ([#2409](https://github.com/MultiQC/MultiQC/pull/2409)) +- Remove CSP.txt and the linting check, move the script that prints missing hashes under `scripts`. Admins of servers with Content Security Policy can use it to print missing hashes when they install a new MultiQC version with: `python scripts/print_missing_csp.py --report full_report.html` ([#2421](https://github.com/MultiQC/MultiQC/pull/2421)) +- Do not maintain change log between releases ([#2427](https://github.com/MultiQC/MultiQC/pull/2427)) +- Use native clipboard API ([#2419](https://github.com/MultiQC/MultiQC/pull/2419)) +- Profile runtime: visualize per-module memory and run time ([#2548](https://github.com/MultiQC/MultiQC/pull/2548), [#2547](https://github.com/MultiQC/MultiQC/pull/2547)) +- Refactoring for performance: + - Search file blocks rather than individual lines for faster results ([#2513](https://github.com/MultiQC/MultiQC/pull/2513)) + - Refactor file content search for a 40% speed increase ([#2505](https://github.com/MultiQC/MultiQC/pull/2505)) + - Sort `filepatterns` for faster searching ([#2506](https://github.com/MultiQC/MultiQC/pull/2506)) + - Use `array.array` for in-memory plot data, stream to render Jinja and dump JSON to reduce memory requirement ([#2515](https://github.com/MultiQC/MultiQC/pull/2515)) + - Speed up all modules by caching `spectra.scale` and using sets instead of lists ([#2509](https://github.com/MultiQC/MultiQC/pull/2509)) + - Stream json data to a file to save 30% of the memory ([#2510](https://github.com/MultiQC/MultiQC/pull/2510)) + - Do `replace_nan` in place rather than creating a new object ([#2529](https://github.com/MultiQC/MultiQC/pull/2529)) + - Use gzip rather than lzstring for compression and decompression of the plot data ([#2504](https://github.com/MultiQC/MultiQC/pull/2504)) + - Use gzip level 6 for faster json compression ([#2553](https://github.com/MultiQC/MultiQC/pull/2553)) + - Clean up module raw data after running each module, significantly reduces the memory footprint ([#2551](https://github.com/MultiQC/MultiQC/pull/2551)) +- Refactoring for interactivity and validation: + - Top-level functions for MultiQC use as a library ([#2442](https://github.com/MultiQC/MultiQC/pull/2442)) + - Pydantic models for plots and datasets ([#2442](https://github.com/MultiQC/MultiQC/pull/2442)) + - Validating plot configs with Pydantic ([#2534](https://github.com/MultiQC/MultiQC/pull/2534)) + - Use dataclasses for table and violin columns ([#2546](https://github.com/MultiQC/MultiQC/pull/2546)) + - Break up the main run function into submodules ([#2446](https://github.com/MultiQC/MultiQC/pull/2446)) + - Deprecate `multiqc.utils.config` and `multiqc.utils.report` in favour of `multiqc.config` and `multiqc.report` ([#2542](https://github.com/MultiQC/MultiQC/pull/2542)) + - Static typing of the report and config modules ([#2445](https://github.com/MultiQC/MultiQC/pull/2445)) + - Add type hints into core codebase ([#2434](https://github.com/MultiQC/MultiQC/pull/2434)) + - Consistent config options: rename `decimalPlaces` to `tt_decimals` ([#2451](https://github.com/MultiQC/MultiQC/pull/2451)) + - Remove encoding and shebang headers from module files ([#2425](https://github.com/MultiQC/MultiQC/pull/2425)) + - Refactor line plot categories: keep boolean throughout the code, and data points as pairs for simplicity ([#2418](https://github.com/MultiQC/MultiQC/pull/2418)) +- Fixes: + - Fix error when using default sort ([#2544](https://github.com/MultiQC/MultiQC/pull/2544)) + - Do not attempt to render flat plot when no data ([#2490](https://github.com/MultiQC/MultiQC/pull/2490)) + - Fix export plots with `--export` and always export data ([#2489](https://github.com/MultiQC/MultiQC/pull/2489)) + - Fix: make sure `modify` lambda not present in JSON dump ([#2455](https://github.com/MultiQC/MultiQC/pull/2455)) + - Enable `--export` even when writing interactive plots ([#2444](https://github.com/MultiQC/MultiQC/pull/2444)) + - Replace `NaN` with `null` in exported JSON ([#2432](https://github.com/MultiQC/MultiQC/pull/2432)) + - Fix `y_minrange` option ([#2415](https://github.com/MultiQC/MultiQC/pull/2415)) +- Reduce report size: exclude plot data for sections in `remove_sections` ([#2460](https://github.com/MultiQC/MultiQC/pull/2460)) +- Add `ge` and `le` to `cond_formatting_rules` ([#2494](https://github.com/MultiQC/MultiQC/pull/2494)) +- CI: use `uv pip` ([#2352](https://github.com/MultiQC/MultiQC/pull/2352)) +- Lint check for use of `f["content_lines"]` ([#2485](https://github.com/MultiQC/MultiQC/pull/2485)) +- Allow to set style of line graph (`lines` or `lines+markers`) per plot ([#2413](https://github.com/MultiQC/MultiQC/pull/2413)) +- Add `CMD` to `Dockerfile` so a default run without any parameters displays the `--help` ([#2279](https://github.com/MultiQC/MultiQC/pull/2279)) + +### New modules + +- [**Hostile**](https://github.com/bede/hostile) ([#2501](https://github.com/MultiQC/MultiQC/pull/2501)) + - New module: Hostile is a short and long host reads removal tool +- [**Sequali**](https://github.com/rhpvorderman/sequali) ([#2441](https://github.com/MultiQC/MultiQC/pull/2441)) + - New module: Sequali Universal sequencing QC + +### Module updates + +- **Adapter Removal** + - Standardize module names: use the came case ([#2433](https://github.com/MultiQC/MultiQC/pull/2433)) +- **Bamdst** + - Fix chromosome reports when contig data labels are missing ([#2479](https://github.com/MultiQC/MultiQC/pull/2479)) + - Fix for the case when `chromosomes.report` is not provided ([#2477](https://github.com/MultiQC/MultiQC/pull/2477)) + - Stress file name requirements for chromosomes report ([#2478](https://github.com/MultiQC/MultiQC/pull/2478)) +- **BBTools** + - Set missing values to `None` for `bbmap qahist` ([#2411](https://github.com/MultiQC/MultiQC/pull/2411)) +- **Bcftools** + - Stats: add multialleic sites column ([#2414](https://github.com/MultiQC/MultiQC/pull/2414)) +- **BCL Convert** + - Show message when no undetermined reads instead of error ([#2526](https://github.com/MultiQC/MultiQC/pull/2526)) + - Fix for absent index reads ([#2511](https://github.com/MultiQC/MultiQC/pull/2511)) + - Add all file types to sources ([#2456](https://github.com/MultiQC/MultiQC/pull/2456)) +- **Busco** + - Fix barplot colors ([#2453](https://github.com/MultiQC/MultiQC/pull/2453)) +- **Cell Ranger** + - Fix parsing antibody tab without `antibody_treemap_plot` ([#2525](https://github.com/MultiQC/MultiQC/pull/2525)) +- **Cutadapt** + - Speed up module by caching parsing versions ([#2528](https://github.com/MultiQC/MultiQC/pull/2528)) +- **DRAGEN** + - Add ploidy estimation table ([#2496](https://github.com/MultiQC/MultiQC/pull/2496)) +- **fastp** + - When could not parse sample name from command (i.e. `stdin`), use filename and proceed ([#2536](https://github.com/MultiQC/MultiQC/pull/2536)) +- **FastQC** + - Skip per tile sequence quality section in FastQC reports for better performance ([#2552](https://github.com/MultiQC/MultiQC/pull/2552)) + - Fix a `ZeroDivisionError` error ([#2462](https://github.com/MultiQC/MultiQC/pull/2462)) + - Fix memory leak to make 7 times faster and use 10 times less memory ([#2552](https://github.com/MultiQC/MultiQC/pull/2552)) + - Do not keep intermediate data in memory to reduce memory footprint further ([#2516](https://github.com/MultiQC/MultiQC/pull/2516) ) + - Add option to ignore FastQC quality thresholds ([#2486](https://github.com/MultiQC/MultiQC/pull/2486)) +- **goleft indexcov** + - Work correctly even if no valid contigs in input ([#2540](https://github.com/MultiQC/MultiQC/pull/2540)) +- **mosdepth** + - Fix absolute coverage plot ([#2488](https://github.com/MultiQC/MultiQC/pull/2488)) +- **nonpareil** + - Change write_data_file label to be consistent with other modules ([#2472](https://github.com/MultiQC/MultiQC/pull/2472)) +- **Picard** + - WgsMetrics: coverage plot: show % based ≥x, not >x ([#2473](https://github.com/MultiQC/MultiQC/pull/2473)) + - CrosscheckFingerprints: support multiple files, preserve sample order in heatmap ([#2454](https://github.com/MultiQC/MultiQC/pull/2454)) +- **qc3C** + - Fix detecting sample name for relative path ([#2502](https://github.com/MultiQC/MultiQC/pull/2502)) +- **QualiMap** + - BamQC: when trimming long tails, keep at least 20x ([#2431](https://github.com/MultiQC/MultiQC/pull/2431)) +- **Samtools** + - Add support for `markdup` ([#2254](https://github.com/MultiQC/MultiQC/pull/2254)) + - Add violin multiple datasets & samtools flagstat percentage switch ([#2430](https://github.com/MultiQC/MultiQC/pull/2430)) +- **Space Ranger** + - fix for missing `genomic_dna` section ([#2429](https://github.com/MultiQC/MultiQC/pull/2429)) +- **xengsort** + - Fix parsing long files (do no use `content_lines`) ([#2484](https://github.com/MultiQC/MultiQC/pull/2484)) + +## New Contributors +* @clintval made their first contribution in https://github.com/MultiQC/MultiQC/pull/2254 +* @alanhoyle made their first contribution in https://github.com/MultiQC/MultiQC/pull/2279 +* @rhpvorderman made their first contribution in https://github.com/MultiQC/MultiQC/pull/2441 +* @TBradley27 made their first contribution in https://github.com/MultiQC/MultiQC/pull/2473 +* @SumeetTiwari07 made their first contribution in https://github.com/MultiQC/MultiQC/pull/2501 + +**Full Changelog**: https://github.com/MultiQC/MultiQC/compare/v1.21...v1.22 diff --git a/changelog/multiqc/v1.23.mdx b/changelog/multiqc/v1.23.mdx new file mode 100644 index 000000000..5d449986c --- /dev/null +++ b/changelog/multiqc/v1.23.mdx @@ -0,0 +1,72 @@ +--- +title: MultiQC v1.23 +date: 2024-07-09 +tags: [multiqc] +--- + +## [MultiQC v1.23](https://github.com/MultiQC/MultiQC/releases/tag/v1.23) + +Bug fixes, integration of `pytest` and `mypy`, and one new module. + +From the user perspective, this is mostly a maintenance release, containing several important bugfixes, plus minor improvements and a new module - Glimpse. + +For developers, there are two significant additions to the CI workflow: + +- [pytest](https://docs.pytest.org/), along with unit tests covering the core library, +- and [mypy](https://mypy-lang.org/), along with ensuring that the core codebase is fully type-annotated. + +The core unit tests are located in the `multiqc/tests` folder, and the module tests are located in the corresponding `multiqc/modules/*/tests` subfolders. The [CI workflows](https://github.com/MultiQC/MultiQC/tree/main/.github/workflows) are refactored to separate the integration tests and the unit tests, to improve the granularity and parallelization. The tests are discovered and executed with pytest, and the coverage is reported by [codecov](https://app.codecov.io/gh/MultiQC/MultiQC). + +The `multiqc/tests` subfolder has several test files that cover most of the core library. It also has a [test_modules_run.py](https://github.com/MultiQC/MultiQC/blob/main/tests/test_modules_run.py) tests that checks that every module didn't crash when being run on the corresponding data in [test-data](https://github.com/MultiQC/test-data), and added _something_ into the report. That is somewhat of a blanket test for modules, that doesn't check if the modules logic worked correctly. For that reason, the users are encouraged to write more comprehensive tests that take the specific module logic into account, and place them in multiqc/modules/*/tests`. For some initial examples, consider checking: + +- The [samtools flagstat](https://github.com/MultiQC/MultiQC/blob/main/multiqc/modules/samtools/tests/test_flagstat.py) test that verifies some logic in the `flagstat` submodule of the `samtools` module; +- The [picard tools](https://github.com/MultiQC/MultiQC/blob/main/multiqc/modules/picard/tests/test_picard.py) test that checks that every submodule for each Picard tool worked correctly. + +### Other changes & fixes + +#### Fixes + +- Custom content" + - Multiple fixes of the custom content parsing logic ([#2674](https://github.com/MultiQC/MultiQC/pull/2674)) + - Fix parsing custom content submodules with a custom config ([#2654](https://github.com/MultiQC/MultiQC/pull/2654)) + - Line plot: fix spreading `extra_series` between multiple datasets ([#2684](https://github.com/MultiQC/MultiQC/pull/2684)) + - Line plot series: allow pass lists instead of x/y tuples to work properly with YAML ([#2683](https://github.com/MultiQC/MultiQC/pull/2683)) +- Re-enabling the `software_version` module section ([#2670](https://github.com/MultiQC/MultiQC/pull/2670)) +- When `--no-ansi` is set, disable colors in `rich_click` too ([#2678](https://github.com/MultiQC/MultiQC/pull/2678)) +- Support CWD path filters ( `./path/...`) in config ([#2676](https://github.com/MultiQC/MultiQC/pull/2676)) +- Fix writing report to stdout with `--filename stdout`, log to stderr ([#2672](https://github.com/MultiQC/MultiQC/pull/2672)) +- Interactive use: + - Reset all config values in `config.reset()`, even those that are not in `config_default.yaml` ([#2660](https://github.com/MultiQC/MultiQC/pull/2660)) + - Reset config between `multiqc.run()` calls ([#2655](https://github.com/MultiQC/MultiQC/pull/2655)) + - Better handling of calling `write_report` twice ([#2688](https://github.com/MultiQC/MultiQC/pull/2688)) + +#### Updates + +- Run mypy on core library ([#2665](https://github.com/MultiQC/MultiQC/pull/2665)) +- Add tests for plot export ([#2682](https://github.com/MultiQC/MultiQC/pull/2682)) +- Add tests for command line use, including for passing `TMPDIR` ([#2677](https://github.com/MultiQC/MultiQC/pull/2677)) +- Custom content: allow hash-fenced table columns ([#2649](https://github.com/MultiQC/MultiQC/pull/2649)) +- Software versions: parse for sorting, but preserve the original strings ([#2671](https://github.com/MultiQC/MultiQC/pull/2671)) +- Allow both table-level and column-level custom plot config for table ([#2662](https://github.com/MultiQC/MultiQC/pull/2662)) + +#### New modules + +- Glimpse ([#2492](https://github.com/MultiQC/MultiQC/pull/2492)) + +#### Module fixes + +- Fix parsing kraken vs. bracken: respect `num_lines` in search patterns ([#2657](https://github.com/MultiQC/MultiQC/pull/2657)) +- Fix the `bbmap/qchist` search pattern ([#2661](https://github.com/MultiQC/MultiQC/pull/2661)) + +#### Module updates + +- Picard HsMetrics: support any custom X coverage metrics ([#2663](https://github.com/MultiQC/MultiQC/pull/2663)) +- Samtools coverage: avoid hard crash for invalid file contents ([#2664](https://github.com/MultiQC/MultiQC/pull/2664)) + +#### Refactoring + +- Abstract code related to temporary directory creation into a separate module ([#2675](https://github.com/MultiQC/MultiQC/pull/2675)) + +#### Infrastructure + +- Use pull-request labels and milestones for changelog generation ([#2691](https://github.com/MultiQC/MultiQC/pull/2691)) diff --git a/changelog/multiqc/v1.24.1.mdx b/changelog/multiqc/v1.24.1.mdx new file mode 100644 index 000000000..c4c728c78 --- /dev/null +++ b/changelog/multiqc/v1.24.1.mdx @@ -0,0 +1,14 @@ +--- +title: MultiQC v1.24.1 +date: 2024-08-21 +tags: [multiqc] +--- + +## [MultiQC v1.24.1](https://github.com/MultiQC/MultiQC/releases/tag/v1.24.1) - 2024-08-21 + +A bug fix release mainly to restore compatibility with Python 3.8. Aside from that, few other minor bug fixes: + +- FastQC: fix long-standing issue misplacing status labels when `anchor` is specified in the custom config ([#2790](https://github.com/MultiQC/MultiQC/pull/2790)) +- Freyja: handle empty inputs, and ensure deterministic sample order ([#2788](https://github.com/MultiQC/MultiQC/pull/2788)) +- Allow numeric `xcats` and `ycats` for the heatmap plot ([#2787](https://github.com/MultiQC/MultiQC/pull/2787)) +- Make sure that config's `extra_fn_clean_exts` and `fn_clean_exts` don't conflict when both specified ([#2783](https://github.com/MultiQC/MultiQC/pull/2783)) diff --git a/changelog/multiqc/v1.24.mdx b/changelog/multiqc/v1.24.mdx new file mode 100644 index 000000000..ef7801165 --- /dev/null +++ b/changelog/multiqc/v1.24.mdx @@ -0,0 +1,116 @@ +--- +title: MultiQC v1.24 +date: 2024-08-19 +tags: [multiqc] +--- + +## [MultiQC v1.24](https://github.com/MultiQC/MultiQC/releases/tag/v1.24) + +Mostly a maintenance release, containing several bug fixes, performance improvements, +plus 6 new modules, along with improvements of the existing modules. + +The most significant performance boost got the Kraken and Mosdepth modules, that now don't +take way more memory and CPU than any other typical module: + +| Tool | Data Set | Memory - Before | CPU - Before | Memory - After | CPU - After | +| -------- | -------------- | --------------- | ------------ | -------------- | ----------- | +| mosdepth | 1 set of files | 196 Mb | 3.04s | 129 Mb | 2.27s | +| | 10 | 464 Mb | 8.48s | 131 Mb | 6.11s | +| | 100 | 3,719 Mb | 63.19s | 172 Mb | 43.12s | +| kraken | 1 set of files | 155 Mb | 2.07s | 132 Mb | 2.20s | +| | 10 | 606 Mb | 8.39s | 180 Mb | 3.47s | +| | 100 | 4,970 Mb | 71.89s | 809 Mb | 14.53s | + +Large plots that may hang browser are now not loaded by default, and the user can click +a button to load, so the heavy plots don't slow down the initial report rendering. This +is controlled by the `config.plots_defer_loading_numseries: 100` option. + +### Updates + +- Search patterns: allow multiple values for `contents` ([#2696](https://github.com/MultiQC/MultiQC/pull/2696)) +- Custom content: + - Allow dict input to heatmap ([#2761](https://github.com/MultiQC/MultiQC/pull/2761)) + - Allow multiple custom content to general stats table ([#2727](https://github.com/MultiQC/MultiQC/pull/2727)) +- Plots: + - Defer render of plots if number of samples > `config.plots_defer_loading_numseries` ([#2759](https://github.com/MultiQC/MultiQC/pull/2759), [#2777](https://github.com/MultiQC/MultiQC/pull/2777), [#2773](https://github.com/MultiQC/MultiQC/pull/2773), [#2774](https://github.com/MultiQC/MultiQC/pull/2774)) + - Line plot: show markers when num of data points < `config.lineplot_number_of_points_to_hide_markers` (=50) ([#2760](https://github.com/MultiQC/MultiQC/pull/2760)). As a nice consequence, trivial lines of a single data point become visible. + - Line plot: smooth by default to 500 points on the X axis to avoid inflating the report file size ([#2776](https://github.com/MultiQC/MultiQC/pull/2776)) + - Allow to configure the scale of the exported plot fonts through the config option `config.plots_export_font_scale` ([#2758](https://github.com/MultiQC/MultiQC/pull/2758)) + - Improve the performance of loading large tables in browser ([#2737](https://github.com/MultiQC/MultiQC/pull/2737)) + - Fix the toolbox highlight of the line plots ([#2724](https://github.com/MultiQC/MultiQC/pull/2724)) +- The function that returns built plots in an interactive session now uses the module anchor (or lowercase module name) to key the results ([#2741](https://github.com/MultiQC/MultiQC/pull/2741)) +- More helpful config validation error: print the parent model name, if applicable ([#2709](https://github.com/MultiQC/MultiQC/pull/2709)) + +### New modules + +- [VG](https://github.com/vgteam/vg) ([#2690](https://github.com/MultiQC/MultiQC/pull/2690)), a toolkit to manipulate graphical genomes. The module parses [vg-stats](https://github.com/vgteam/vg/wiki/Mapping-short-reads-with-Giraffe#evaluating-with-vg-stats) reports that summarize alignment stats from a GAM file. +- [ngs-bits](https://github.com/imgag/ngs-bits) ([#2231](https://github.com/MultiQC/MultiQC/pull/2231)). A tool that calculating statistics from FASTQ, BAM, and VCF files. The module parses XML output generated for two tools in the ngs-bits collection: + - [ReadQC](https://github.com/imgag/ngs-bits/blob/master/doc/tools/ReadQC.md) for FastQ file stats + - [MappingQC](https://github.com/imgag/ngs-bits/blob/master/doc/tools/MappingQC.md) for BAM file stats +- [Pairtools](https://github.com/mirnylab/pairtools) ([#1148](https://github.com/MultiQC/MultiQC/pull/1148)). A toolkit for Chromatin Conformation Capture experiments. Handles short-reads paired reference alignments, extracts 3C-specific information, and perform common tasks such as sorting, filtering, and deduplication. The module parses summary statistics generated by pairtools's `dedup` and `stats` tools. +- [nanoq](https://github.com/nerdna/nanoq/) ([#2723](https://github.com/MultiQC/MultiQC/pull/2723)). A tool that reports read quality and length from nanopore sequencing data. +- [Ganon](https://pirovc.github.io/ganon/) ([#1935](https://github.com/MultiQC/MultiQC/pull/1935)). A tool for metagenomics classification: quickly assigns sequence fragments to their closest reference among thousands of references via Interleaved Bloom Filters of k-mer/minimizers + +### Fixes + +- Fix `--pdf` option to generate `multiqc_report.pdf` ([#2733](https://github.com/MultiQC/MultiQC/pull/2733)) +- Fix saving table plots to file ([#2735](https://github.com/MultiQC/MultiQC/pull/2735)) +- Fix adding software versions when `config.run_modules` is set ([#2755](https://github.com/MultiQC/MultiQC/pull/2755)) +- Fix toolbox highlight in line plots ([#2724](https://github.com/MultiQC/MultiQC/pull/2724)) +- Refactor `write_results` to avoid dynamically overriding `config`, fixes `module.write_data_file` ([#2722](https://github.com/MultiQC/MultiQC/pull/2722)) +- Search stats: do not double-count ignored files ([#2708](https://github.com/MultiQC/MultiQC/pull/2708)) +- Escape values passed to HTML properties (e.g. `val` in tables) ([#2706](https://github.com/MultiQC/MultiQC/pull/2706)) +- Fix re-loading explicit user configs in interactive sessions ([#2704](https://github.com/MultiQC/MultiQC/pull/2704)) +- Fix file search performance regression ([#2762](https://github.com/MultiQC/MultiQC/pull/2762)) +- Fix handling module href string ([#2739](https://github.com/MultiQC/MultiQC/pull/2739)) +- Custom content: + - Cast names to strings instead of asserting (allows numerical sample names) ([#2769](https://github.com/MultiQC/MultiQC/pull/2769)) + - Fix parsing custom content tables with numerical samples ([#2705](https://github.com/MultiQC/MultiQC/pull/2705)) + - Section order and custom content order: allow skip the `*-module` suffix from anchors ([#2770](https://github.com/MultiQC/MultiQC/pull/2770)) + +### Module updates + +- Kraken: optimize memory and runtime ([#2756](https://github.com/MultiQC/MultiQC/pull/2756)) +- Mosdepth: optimize memory and runtime ([#2748](https://github.com/MultiQC/MultiQC/pull/2748), [#2749](https://github.com/MultiQC/MultiQC/pull/2749)) +- Abstract `config.get_cov_thresholds` function for `mosdepth` and `qualimap` ([#2707](https://github.com/MultiQC/MultiQC/pull/2707)) +- Anglerfish: adjust for version 0.6.1 ([#2757](https://github.com/MultiQC/MultiQC/pull/2757)) +- Umitools: prefer output for sample name, handle the ``/`` placeholders ([#2698](https://github.com/MultiQC/MultiQC/pull/2698)) +- Kraken: fix top % calculation, more efficient total read count calculation ([#2744](https://github.com/MultiQC/MultiQC/pull/2744)) +- Bracken: when printing number of found samples, indicate that running Bracken not Kraken ([#2743](https://github.com/MultiQC/MultiQC/pull/2743)) +- Nonpareil: Update docs about new version that generates the JSON file ([#2734](https://github.com/MultiQC/MultiQC/pull/2734)) +- STAR: add all alignment summary metrics into a new separate table ([#1828](https://github.com/MultiQC/MultiQC/pull/1828)) +- Pairtools: fix typos and grammar, remove redundancies ([#2711](https://github.com/MultiQC/MultiQC/pull/2711)) +- Peddy sex plot: color predicted sex ([#2778](https://github.com/MultiQC/MultiQC/pull/2778)) + +### Module fixes + +- Cellranger: fix for missing `analysis_tab` data ([#2771](https://github.com/MultiQC/MultiQC/pull/2771)) +- Fix setting coverage thresholds for `mosdepth` and `qualimap` ([#2754](https://github.com/MultiQC/MultiQC/pull/2754)) +- Nonpareil: fix running with >12 samples ([#2752](https://github.com/MultiQC/MultiQC/pull/2752)) +- Bracken: fix bug when direct reads not classified ([#2738](https://github.com/MultiQC/MultiQC/pull/2738)) +- ngsderive: fix ValueError in the `encoding` submodule ([#2740](https://github.com/MultiQC/MultiQC/pull/2740)) +- RSeQC: fix duplicated namespace ([#2732](https://github.com/MultiQC/MultiQC/pull/2732)) +- Glimpse: fix parsing data, add proper type hints ([#2721](https://github.com/MultiQC/MultiQC/pull/2721)) +- Fix ignoring samples in `spaceranger`, `ngsbits`, `isoseq`, `dragen coverage` ([#2717](https://github.com/MultiQC/MultiQC/pull/2717)) +- Glimpse: clean and fix filtering samples ([#2716](https://github.com/MultiQC/MultiQC/pull/2716)) +- Spaceranger: fix ignoring samples ([#2714](https://github.com/MultiQC/MultiQC/pull/2714)) + +### Refactoring + +- Refactor `write_results` to avoid dynamically overriding `config`, fixes `module.write_data_file` ([#2722](https://github.com/MultiQC/MultiQC/pull/2722)) +- Modules: + - isoseq and odgi: fix module warnings and error handling ([#2718](https://github.com/MultiQC/MultiQC/pull/2718)) + - Qualimap: refactor and add type hints ([#2707](https://github.com/MultiQC/MultiQC/pull/2707)) + - FastQC: refactor and add type hints ([#2763](https://github.com/MultiQC/MultiQC/pull/2763)) + - Kraken: refactor and add type hints ([#2744](https://github.com/MultiQC/MultiQC/pull/2744)) + - Cell Ranger: refactor, add type hints, get rid of module mixins and fields ([#2775](https://github.com/MultiQC/MultiQC/pull/2775)) + - Spaceranger: refactor, add type hints, get rid of module mixins and fields ([#2714](https://github.com/MultiQC/MultiQC/pull/2714)) + - RSeQC: refactor, add type hints, and remove `multiqc_rseqc.js` ([#2710](https://github.com/MultiQC/MultiQC/pull/2710)) + +### Infrastructure + +- Split up the tests for sample versions discovery ([#2751](https://github.com/MultiQC/MultiQC/pull/2751)) +- Move integration test variations into unit tests, actually test them ([#2713](https://github.com/MultiQC/MultiQC/pull/2713)) +- Move module docs to the docstrings & generate `docs/modules/*.md` from the docstrings using a separate script ([#2703](https://github.com/MultiQC/MultiQC/pull/2703)) +- Embed the search patterns into the module docs ([#2765](https://github.com/MultiQC/MultiQC/pull/2765)) +- Dockerfile: use `COPY` instead of `ADD` to copy only relevant files, update base image to Python 3.12 ([#2700](https://github.com/MultiQC/MultiQC/pull/2700)) diff --git a/changelog/multiqc/v1.25.1.mdx b/changelog/multiqc/v1.25.1.mdx index 98e87e803..f88c0c620 100644 --- a/changelog/multiqc/v1.25.1.mdx +++ b/changelog/multiqc/v1.25.1.mdx @@ -6,7 +6,7 @@ tags: [multiqc] Python 3.13, bugs fixed, improved sample grouping UI, and handling freezes in containers with incompatible architectures. -{/* truncate */} + ### Updates diff --git a/changelog/multiqc/v1.25.mdx b/changelog/multiqc/v1.25.mdx new file mode 100644 index 000000000..533c90148 --- /dev/null +++ b/changelog/multiqc/v1.25.mdx @@ -0,0 +1,71 @@ +--- +title: MultiQC v1.25 +date: 2024-09-17 +tags: [multiqc] +--- + +## [MultiQC v1.25](https://github.com/MultiQC/MultiQC/releases/tag/v1.25) - 2024-09-16 + +### Highlights - sample grouping + +New feature: grouping samples in the General Statistics table. + + + +Some modules - prominently FastQC - may produce multiple results per sample, e.g. for the forward and the reverse reads. To group such results in the table together, a new [configuration option](https://multiqc.info/docs/reports/customisation/#sample-grouping) is introduced. + +This feature is currently opt-in, you'll need to set `table_sample_merge` in a MultiQC config file to use (see docs above). **We'd love to hear your feedback!** We hope to enable it by default for common file suffix patterns in a future release. + +Because MultiQC needs to know how to merge each column (sum, average, etc), each module must implement it independently. Currently it's supported by the FastQC and Cutadapt modules. If you'd like support added to another module, please let us know in a GitHub issue. Details of how to add it into module code can be found in the [moduel development documentation](https://multiqc.info/docs/development/modules/#grouping-samples). + +### Highlights - box plots in custom content + +The new box plot plot type, added in v1.21, are now available to use with custom content! See [2847](https://github.com/MultiQC/MultiQC/pull/2847) for configuration examples. + +### New modules + +- Add UMICollapse module ([#2814](https://github.com/MultiQC/MultiQC/pull/2814), [#2827](https://github.com/MultiQC/MultiQC/pull/2827)) + +### Updates + +- Group read pairs in general stats ([#2794](https://github.com/MultiQC/MultiQC/pull/2794), [#2848](https://github.com/MultiQC/MultiQC/pull/2848)) +- Support boxplot in custom content ([#2847](https://github.com/MultiQC/MultiQC/pull/2847)) +- Allow `x_band`, `x_lines`, `x_minrange` for any plot type (specifically, scatter plots) ([#2851](https://github.com/MultiQC/MultiQC/pull/2851)) +- When both `contents` and `contents_re` are specified in a search patterns, treat it as logical AND ([#2828](https://github.com/MultiQC/MultiQC/pull/2828)) + +### Module updates + +- NanoStat: support multi-sample logs ([#2852](https://github.com/MultiQC/MultiQC/pull/2852)) +- Samtools coverage: support `exclude_contigs` and `include_contigs` ([#2840](https://github.com/MultiQC/MultiQC/pull/2840)) +- Ganon: support non-verbose output, fix missing `removed with --min-count` ([#2838](https://github.com/MultiQC/MultiQC/pull/2838)) +- fastp: support the `--merged` flag ([#2834](https://github.com/MultiQC/MultiQC/pull/2834)) + +### Fixes + +- Workaround for the hanging Kaleido duing plot export: run plot export in separate threads with a timeout and fallback on freezes, add try-catch for crashes ([#2836](https://github.com/MultiQC/MultiQC/pull/2836), [#2819](https://github.com/MultiQC/MultiQC/pull/2819)) +- Fix copying `multiqc.log` into the `multiqc_data` output folder ([#2829](https://github.com/MultiQC/MultiQC/pull/2829)) +- Fix applying `exclude_files` in search patterns ([#2804](https://github.com/MultiQC/MultiQC/pull/2804)) +- Fix bar plot export from toolbox ([#2845](https://github.com/MultiQC/MultiQC/pull/2845)) +- Fix autoselection in plot export toolbox ([#2844](https://github.com/MultiQC/MultiQC/pull/2844)) +- Fix `config.replace_samples` for custom content genstats table ([#2841](https://github.com/MultiQC/MultiQC/pull/2841)) + +### Module fixes + +- Picard: fix parsing Sentieon insert size metrics ([#2823](https://github.com/MultiQC/MultiQC/pull/2823)) +- Picard: fix a search pattern of CollectRnaSeqMetrics ([#2811](https://github.com/MultiQC/MultiQC/pull/2811)) +- Kraken: fix for empty top ranks. Also handle it in bargraph ([#2822](https://github.com/MultiQC/MultiQC/pull/2822)) +- Cellranger: fix data source tag ([#2821](https://github.com/MultiQC/MultiQC/pull/2821)) +- FastQC: fix the `Per Base Sequence Content` detail plot click when a module was run multiple times ([#2856](https://github.com/MultiQC/MultiQC/pull/2856)) +- FastQC: fix calculating average read length ([#2817](https://github.com/MultiQC/MultiQC/pull/2817)) + +### Refactoring and typing + +- Separate anchors and IDs for sections: use IDs for Python configation, and anchors in HTML ([#2797](https://github.com/MultiQC/MultiQC/pull/2797), [#2833](https://github.com/MultiQC/MultiQC/pull/2833)) +- Prefix table column IDs with namespace, but allow configuration to use both short and long anchors ([#2818](https://github.com/MultiQC/MultiQC/pull/2818)) +- More type hinting in plots ([#2816](https://github.com/MultiQC/MultiQC/pull/2816), [#2850](https://github.com/MultiQC/MultiQC/pull/2850)) +- Use `typing.NewType` for all Python versions ([#2820](https://github.com/MultiQC/MultiQC/pull/2820)) +- Remove `pyaml_env` dependency and apply the fix for the `SyntaxWarning` ([#2837](https://github.com/MultiQC/MultiQC/pull/2837)) + +### Infrastructure and packaging + +- Add `py.typed` to mark package as providing type information ([#2846](https://github.com/MultiQC/MultiQC/pull/2846)) diff --git a/changelog/multiqc/v1.3.mdx b/changelog/multiqc/v1.3.mdx new file mode 100644 index 000000000..12a00b0ba --- /dev/null +++ b/changelog/multiqc/v1.3.mdx @@ -0,0 +1,85 @@ +--- +title: MultiQC v1.3 +date: 2017-11-03 +tags: [multiqc] +--- + +There are 34 merged pull-requests in this release - a fantastic example of how an open source community can develop a tool! Many thanks to everyone involved for their hard work. + +#### Breaking changes - custom search patterns +Only for users with custom search patterns for the `bowtie` or `star`: you will +need to update your config files - the `bowtie` search key is now `bowtie1`, +`star_genecounts` is now `star/genecounts`. + +For users with custom modules - search patterns _must_ now conform to the search +pattern naming convention: `modulename` or `modulename/anything` (the search pattern +string beginning with the name of your module, anything you like after the first `/`). + +#### New Modules: +* [**10X Supernova**](https://support.10xgenomics.com/de-novo-assembly/software/overview/welcome) + * Parses statistics from the _de-novo_ Supernova software. + * Module written by [@remiolsen](https://github.com/remiolsen/) +* [**BBMap**](https://sourceforge.net/projects/bbmap/) + * Plot metrics from a number of BBMap tools, a suite of DNA/RNA mapping tools and utilities + * Module written by [@boulund](https://github.com/boulund/) and [@epruesse](https://github.com/epruesse/) +* [**deepTools**](https://github.com/fidelram/deepTools) - new module! + * Parse text output from `bamPEFragmentSize`, `estimateReadFiltering`, `plotCoverage`, `plotEnrichment`, and `plotFingerprint` + * Module written by [@dpryan79](https://github.com/dpryan79/) +* [**Homer Tag Directory**](http://homer.ucsd.edu/homer/ngs/tagDir.html) - new submodule! + * Module written by [@rdali](https://github.com/rdali/) +* [**illumina InterOp**](http://illumina.github.io/interop/index.html) + * Module to parse metrics from illumina sequencing runs and demultiplexing, generated by the InterOp package + * Module written by [@matthdsm](https://github.com/matthdsm/) +* [**RSEM**](https://deweylab.github.io/RSEM/) - new module! + * Parse `.cnt` file comming from rsem-calculate-expression and plot read repartitions (Unalignable, Unique, Multi ...) + * Module written by [@noirot](https://github.com/noirot/) +* [**HiCExplorer**](https://github.com/maxplanck-ie/HiCExplorer) + * New module to parse the log files of `hicBuildMatrix`. + * Module written by [@joachimwolff](https://github.com/joachimwolff/) + +#### Module updates: +* **AfterQC** + * Handle new output format where JSON summary key changed names. +* **bcl2fastq** + * Clusters per sample plot now has tab where counts are categoried by lane. +* **GATK** + * New submodule to handle Base Recalibrator stats, written by [@winni2k](https://github.com/winni2k/) +* **HiSAT2** + * Fixed bug where plot title was incorrect if both SE and PE bargraphs were in one report +* **Picard HsMetrics** + * Parsing code can now handle commas for decimal places +* **Preseq** + * Updated odd file-search pattern that limited input files to 500kb +* **QoRTs** + * Added new plots, new helptext and updated the module to produce a lot more output. +* **Qualimap BamQC** + * Fixed edge-case bug where the refactored coverage plot code could raise an error from the `range` call. +* Documentation and link fixes for Slamdunk, GATK, bcl2fastq, Adapter Removal, FastQC and main docs + * Many of these spotted and fixed by [@juliangehring](https://github.com/juliangehring/) +* Went through all modules and standardised plot titles + * All plots should now have a title with the format _Module name: Plot name_ + +#### New MultiQC Features: +* New MultiQC docker image + * Ready to use docker image now available at https://hub.docker.com/r/ewels/multiqc/ (200 MB) + * Uses automated builds - pull `:latest` to get the development version, future releases will have stable tags. + * Written by [@MaxUlysse](https://github.com/MaxUlysse/) +* New `module_order` config options allow modules to be run multiple times + * Filters mean that a module can be run twice with different sets of files (eg. before and after trimming) + * Custom module config parameters can be passed to module for each run +* File search refactored to only search for running modules + * Makes search much faster when running with lots of files and limited modules + * For example, if using `-m star` to only use the STAR module, all other file searches now skipped +* File search now warns if an unrecognised search type is given +* MultiQC now saves nearly all parsed data to a structured output file by default + * See `multiqc_data/multiqc_data.json` + * This can be turned off by setting `config.data_dump_file: false` +* Verbose logging when no log files found standardised. Less duplication in code and logs easier to read! +* New documentation section describing how to use MultiQC with Galaxy +* Using `shared_key: 'read_counts'` in table header configs now applies relevant defaults + +#### Bug Fixes +* Installation problem caused by changes in upstream dependencies solved by stricter installation requirements +* Minor `default_dev` directory creation bug squashed +* Don't prepend the directory separator (`|`) to sample names with `-d` when there are no subdirs +* `yPlotLines` now works even if you don't set `width` diff --git a/changelog/multiqc/v1.4.mdx b/changelog/multiqc/v1.4.mdx new file mode 100644 index 000000000..aa5b6c265 --- /dev/null +++ b/changelog/multiqc/v1.4.mdx @@ -0,0 +1,54 @@ +--- +title: MultiQC v1.4 +date: 2018-01-11 +tags: [multiqc] +--- + + +A slightly earlier-than-expected release due to a new problem with dependency packages that is breaking MultiQC installations since 2018-01-11. + +#### New Modules: +* [**Sargasso**](http://statbio.github.io/Sargasso/) + * Parses output from Sargasso - a tool to separate mixed-species RNA-seq reads according to their species of origin + * Module written by [@hxin](https://github.com/hxin/) +* [**VerifyBAMID**](https://genome.sph.umich.edu/wiki/VerifyBamID) + * Parses output from VerifyBAMID - a tool to detect contamination in BAM files. + * Adds the `CHIPMIX` and `FREEMIX` columns to the general statistics table. + * Module written by [@aledj2](https://github.com/aledj2/) + +#### Module updates: +* **MACS2** + * Updated to work with output from older versions of MACS2 by [@avilella](https://github.com/avilella/) +* **Peddy** + * Add het check plot to suggest potential contamination by [@aledj2](https://github.com/aledj2) +* **Picard** + * Picard HsMetrics `HS_PENALTY` plot now has correct axis labels + * InsertSizeMetrics switches commas for points if it can't convert floats. Should help some european users. +* **QoRTs** + * Added support for new style of output generated in the v1.3.0 release +* **Qualimap** + * New `Error rate` column in General Statistics table, added by [@Cashalow](https://github.com/Cashalow/) + * Hidden by default - customise your MultiQC config to always show this column (see [docs](http://multiqc.info/docs/#hiding-columns)) +* **QUAST** + * New option to customise the default display of contig count and length (eg. `bp` instead of `Mbp`). + * See [documentation](http://multiqc.info/docs/#quast). Written by [@ewels](https://github.com/ewels/) and [@Cashalow](https://github.com/Cashalow/) +* **RSeQC** + * Removed normalisation in Junction Saturation plot. Now raw counts instead of % of total junctions. + +#### New MultiQC Features: +* Conditional formatting / highlighting of cell contents in tables + * If you want to make values that match a criteria stand out more, you can now write custom rules and formatting instructions for tables. + * For instructions, see [the documentation](http://multiqc.info/docs/#conditional-formatting) +* New `--lint` option which is strict about best-practices for writing new modules + * Useful when writing new modules and code as it throws warnings + * Currently only implemented for bar plots and a few other places. More linting coming soon... +* If MultiQC breaks and shows am error message, it now reports the filename of the last log it found + * Hopefully this will help with debugging / finding dodgy input data + +#### Bug Fixes +* Addressed new dependency error with conflicting package requirements + * There was a conflict between the `networkx`, `colormath` and `spectra` releases. + * I previously forced certain software versions to get around this, but `spectra` has now updated with the unfortunate effect of introducing a new dependency clash that halts installation. +* Fixed newly introduced bug where Custom Content MultiQC config file search patterns had been broken +* Updated pandoc command used in `--pdf` to work with new releases of Pandoc +* Made config `table_columns_visible` module name key matching case insensitive to make less frustrating diff --git a/changelog/multiqc/v1.5.mdx b/changelog/multiqc/v1.5.mdx new file mode 100644 index 000000000..97d79b0b5 --- /dev/null +++ b/changelog/multiqc/v1.5.mdx @@ -0,0 +1,57 @@ +--- +title: MultiQC v1.5 +date: 2018-03-15 +tags: [multiqc] +--- + + +#### New Modules: +* [**DeDup**](http://www.github.com/apeltzer/DeDup) - New module! + * DeDup: Improved Duplicate Removal for merged/collapsed reads in ancient DNA analysis + * Module written by [@apeltzer](https://github.com/apeltzer), +* [**Clip&Merge**](http://github.com/apeltzer/ClipAndMerge) - New module! + * Clip&Merge: Adapter clipping and read merging for ancient DNA analysis + * Module written by [@apeltzer](https://github.com/apeltzer), + +#### Module updates: +* **bcl2fastq** + * Catch `ZeroDivisionError` exceptions when there are 0 reads ([@aledj2](https://github.com/aledj2)) + * Add parsing of `TrimmedBases` and new General Stats column for % bases trimmed ([@matthdsm](https://github.com/matthdsm)). +* **BUSCO** + * Fixed configuration bug that made all sample names become `'short'` +* **Custom Content** + * Parsed tables now exported to `multiqc_data` files +* **Cutadapt** + * Refactor parsing code to collect all length trimming plots +* **FastQC** + * Fixed starting y-axis label for GC-content lineplot being incorrect. +* **HiCExplorer** + * Updated to work with v2.0 release. +* **Homer** + * Made parsing of `tagInfo.txt` file more resilient to variations in file format so that it works with new versions of Homer. + * Kept order of chromosomes in coverage plot consistent. +* **Peddy** + * Switch `Sex error` logic to `Correct sex` for better highlighting ([@aledj2](https://github.com/aledj2)) +* **Picard** + * Updated module and search patterns to recognise new output format from Picard version >= 2.16 and GATK output. +* **Qualimap BamQC** + * Fixed bug where start of _Genome Fraction_ could have a step if target is 100% covered. +* **RNA-SeQC** + * Added rRNA alignment stats to summary table [@Rolandde](https://github.com/Rolandde) +* **RSeqC** + * Fixed read distribution plot by adding category for `other_intergenic` (thanks to [@moxgreen](https://github.com/moxgreen)) + * Fixed a dodgy plot title (Read GC content) +* **Supernova** + * Added support for Supernova 2.0 reports. Fixed a TypeError bug when using txt reports only. Also a bug when parsing empty histogram files. + +#### New MultiQC Features: +* Invalid choices for `--module` or `--exclude` now list the available modules alphabetically. +* Linting now checks for presence in `config.module_order` and tags. + +#### Bug Fixes +* Excluding modules now works in combination with using module tags. +* Fixed edge-case bug where certain combinations of `output_fn_name` and `data_dir_name` could trigger a crash +* Conditional formatting - values are now longer double-labelled +* Made config option `extra_series` work in scatter plots the same way that it works for line plots +* Locked the `matplotlib` version to `v2.1.0` and below + * Due to [two](https://github.com/matplotlib/matplotlib/issues/10476) [bugs](https://github.com/matplotlib/matplotlib/issues/10784) that appeared in `v2.2.0` - will remove this constraint when there's a new release that works again. diff --git a/changelog/multiqc/v1.6.mdx b/changelog/multiqc/v1.6.mdx new file mode 100644 index 000000000..272e55302 --- /dev/null +++ b/changelog/multiqc/v1.6.mdx @@ -0,0 +1,82 @@ +--- +title: MultiQC v1.6 +date: 2018-08-04 +tags: [multiqc] +--- + +Some of these updates are thanks to the efforts of people who attended the [NASPM](https://twitter.com/NordicGenomics) 2018 MultiQC hackathon session. Thanks to everyone who attended! + +#### New Modules: +* [**fastp**](https://github.com/OpenGene/fastp) + * An ultra-fast all-in-one FASTQ preprocessor (QC, adapters, trimming, filtering, splitting...) + * Module started by [@florianduclot](https://github.com/florianduclot/) and completed by [@ewels](https://github.com/ewels/) +* [**hap.py**](https://github.com/Illumina/hap.py) + * Hap.py is a set of programs based on htslib to benchmark variant calls against gold standard truth datasets + * Module written by [@tsnowlan](https://github.com/tsnowlan/) +* [**Long Ranger**](https://support.10xgenomics.com/genome-exome/software/pipelines/latest/what-is-long-ranger) + * Works with data from the 10X Genomics Chromium. Performs sample demultiplexing, barcode processing, alignment, quality control, variant calling, phasing, and structural variant calling. + * Module written by [@remiolsen](https://github.com/remiolsen/) +* `**miRTrace**` + * A quality control software for small RNA sequencing data. + * Module written by [@chuan-wang](https://github.com/chuan-wang/) + +#### Module updates: +* **BCFtools** + * New plot showing SNP statistics versus quality of call from bcftools stats ([@MaxUlysse](https://github.com/MaxUlysse) and [@Rotholandus](https://github.com/Rotholandus)) +* **BBMap** + * Support added for BBDuk kmer-based adapter/contaminant filtering summary stats ([@boulund](https://github.com/boulund) +* **FastQC** + * New read count plot, split into unique and duplicate reads if possible. + * Help text added for all sections, mostly copied from the excellent FastQC help. + * Sequence duplication plot rescaled +* **FastQ Screen** + * Samples in large-sample-number plot are now sorted alphabetically ([@hassanfa](https://github.com/hassanfa) +* **MACS2** + * Output is now more tolerant of missing data (no plot if no data) +* **Peddy** + * Background samples now shown in ancestry PCA plot ([@roryk](https://github.com/roryk)) + * New plot showing sex checks versus het ratios, supporting unknowns ([@oyvinev](https://github.com/oyvinev)) +* **Picard** + * New submodule to handle `ValidateSamFile` reports ([@cpavanrun](https://github.com/cpavanrun)) + * WGSMetrics now add the mean and standard-deviation coverage to the general stats table (hidden) ([@cpavanrun](https://github.com/cpavanrun)) +* **Preseq** + * New config option to plot preseq plots with unique old coverage on the y axis instead of read count + * Code refactoring by [@vladsaveliev](https://github.com/vladsaveliev) +* **QUAST** + * Null values (`-`) in reports now handled properly. Bargraphs always shown despite varying thresholds. ([@vladsaveliev](https://github.com/vladsaveliev)) +* **RNA-SeQC** + * Don't create the report section for Gene Body Coverage if no data is given +* **Samtools** + * Fixed edge case bug where MultiQC could crash if a sample had zero count coverage with idxstats. + * Adds % proper pairs to general stats table +* **Skewer** + * Read length plot rescaled +* **Tophat** + * Fixed bug where some samples could be given a blank sample name ([@lparsons](https://github.com/lparsons)) +* **VerifyBamID** + * Change column header help text for contamination to match percentage output ([@chapmanb](https://github.com/chapmanb)) + +#### New MultiQC Features: +* New config option `remove_sections` to skip specific report sections from modules +* Add `path_filters_exclude` to exclude certain files when running modules multiple times. You could previously only include certain files. +* New `exclude_*` keys for file search patterns + * Have a subset of patterns to exclude otherwise detected files with, by filename or contents +* Command line options all now use mid-word hyphens (not a mix of hyphens and underscores) + * Old underscore terms still maintained for backwards compatibility +* Flag `--view-tags` now works without requiring an "analysis directory". +* Removed Python dependency for `enum34` ([@boulund](https://github.com/boulund)) +* Columns can be added to `General Stats` table for custom content/module. +* New `--ignore-symlinks` flag which will ignore symlinked directories and files. +* New `--no-megaqc-upload` flag which disables automatically uploading data to MegaQC + +#### Bug Fixes +* Fix path_filters for top_modules/module_order configuration only selecting if *all* globs match. It now filters searches that match *any* glob. +* Empty sample names from cleaning are now no longer allowed +* Stop prepend_dirs set in the config from getting clobbered by an unpassed CLI option ([@tsnowlan](https://github.com/tsnowlan)) +* Modules running multiple times now have multiple sets of columns in the General Statistics table again, instead of overwriting one another. +* Prevent tables from clobbering sorted row orders. +* Fix linegraph and scatter plots data conversion (sporadically the incorrect `ymax` was used to drop data points) ([@cpavanrun](https://github.com/cpavanrun)) +* Adjusted behavior of ceiling and floor axis limits +* Adjusted multiple file search patterns to make them more specific + * Prevents the wrong module from accidentally slurping up output from a different tool. By [@cpavanrun](https://github.com/cpavanrun) (see [PR #727](https://github.com/ewels/MultiQC/pull/727)) +* Fixed broken report bar plots when `-p`/`--export-plots` was specified (see issue [#801](https://github.com/ewels/MultiQC/issues/801)) diff --git a/changelog/multiqc/v1.7.mdx b/changelog/multiqc/v1.7.mdx new file mode 100644 index 000000000..89958e69a --- /dev/null +++ b/changelog/multiqc/v1.7.mdx @@ -0,0 +1,77 @@ +--- +title: MultiQC v1.7 +date: 2018-12-21 +tags: [multiqc] +--- + +An early Christmas present for MultiQC users! 🎅🎁🎄 + +Many thanks to everyone who has contributed to this release. Happy Christmas and a very happy new year! + +#### New Modules: +* [**BISCUIT**](https://github.com/zwdzwd/biscuit) + * BISuilfite-seq CUI Toolkit + * Module written by [@zwdzwd](https://github.com/zwdzwd/) +* [**DamageProfiler**](https://github.com/Integrative-Transcriptomics/DamageProfiler) + * A tool to determine ancient DNA misincorporation rates. + * Module written by [@apeltzer](https://github.com/apeltzer/) +* [**FLASh**](https://ccb.jhu.edu/software/FLASH/) + * FLASH (Fast Length Adjustment of SHort reads) + * Module written by [@pooranis](https://github.com/pooranis/) +* [**MinIONQC**](https://github.com/roblanf/minion_qc) + * QC of reads from ONT long-read sequencing + * Module written by [@ManavalanG](https://github.com/ManavalanG) +* [**phantompeakqualtools**](https://www.encodeproject.org/software/phantompeakqualtools) + * A tool for informative enrichment and quality measures for ChIP-seq/DNase-seq/FAIRE-seq/MNase-seq data. + * Module written by [@chuan-wang](https://github.com/chuan-wang/) +* [**Stacks**](http://catchenlab.life.illinois.edu/stacks/) + * A software for analyzing restriction enzyme-based data (e.g. RAD-seq). Support for Stacks >= 2.1 only. + * Module written by [@remiolsen](https://github.com/remiolsen/) + +#### Module updates: +* **AdapterRemoval** + * Handle error when zero bases are trimmed. See [#838](https://github.com/ewels/MultiQC/issues/838). +* **Bcl2fastq** + * New plot showing the top twenty of undetermined barcodes by lane. + * Informations for R1/R2 are now separated in the General Statistics table. + * SampleID is concatenate with SampleName because in Chromium experiments several sample have the same SampleName. +* **deepTools** + * New PCA plots from the `plotPCA` function (written by [@chuan-wang](https://github.com/chuan-wang/)) + * New fragment size distribution plots from `bamPEFragmentSize --outRawFragmentLengths` (written by [@chuan-wang](https://github.com/chuan-wang/)) + * New correlation heatmaps from the `plotCorrelation` function (written by [@chuan-wang](https://github.com/chuan-wang/)) + * New sequence distribution profiles around genes, from the `plotProfile` function (written by [@chuan-wang](https://github.com/chuan-wang/)) + * Reordered sections +* **Fastp** + * Fixed bug in parsing of empty histogram data. See [#845](https://github.com/ewels/MultiQC/issues/845). +* **FastQC** + * Refactored _Per Base Sequence Content_ plots to show original underlying data, instead of calculating it from the page contents. Now shows original FastQC base-ranges and fixes 100% GC bug in final few pixels. See [#812](https://github.com/ewels/MultiQC/issues/812). + * When including a FastQC section multiple times in one report, the summary progress bars now behave as you would expect. +* **FastQ Screen** + * Don't hide genomes in the simple plot, even if they have zero unique hits. See [#829](https://github.com/ewels/MultiQC/issues/829). +* **InterOp** + * Fixed bug where read counts and base pair yields were not displaying in tables correctly. + * Number formatting for these fields can now be customised in the same way as with other modules, as described [in the docs](http://multiqc.info/docs/#number-base-multiplier) +* **Picard** + * InsertSizeMetrics: You can now configure to what degree the insert size plot should be smoothed. + * CollectRnaSeqMetrics: Add warning about missing rRNA annotation. + * CollectRnaSeqMetrics: Add chart for counts/percentage of reads mapped to the correct strand. + * Now parses VariantCallingMetrics reports. (Similar to GATK module's VariantEval.) +* **phantompeakqualtools** + * Properly clean sample names +* **Trimmomatic** + * Updated Trimmomatic module documentation to be more helpful + * New option to use filenames instead of relying on the command line used. See [#864](https://github.com/ewels/MultiQC/issues/864). + +#### New MultiQC Features: +* Embed your custom images with a new Custom Content feature! Just add `_mqc` to the end of the filename for `.png`, `.jpg` or `.jpeg` files. +* Documentation for Custom Content reordered to make it a little more sane +* You can now add or override any config parameter for any MultiQC plot! See [the documentation](http://multiqc.info/docs/#customising-plots) for more info. +* Allow `table_columns_placement` config to work with table IDs as well as column namespaces. See [#841](https://github.com/ewels/MultiQC/issues/841). +* Improved visual spacing between grouped bar plots + + +#### Bug Fixes: +* Custom content no longer clobbers `col1_header` table configs +* The option `--file-list` that refers to a text file with file paths to analyse will no longer ignore directory paths +* [Sample name directory prefixes](https://multiqc.info/docs/#sample-names-prefixed-with-directories) are now added _after_ cleanup. +* If a module is run multiple times in one report, it's CSS and JS files will only be included once (`default` template) diff --git a/changelog/multiqc/v1.8.mdx b/changelog/multiqc/v1.8.mdx new file mode 100644 index 000000000..9f940f99b --- /dev/null +++ b/changelog/multiqc/v1.8.mdx @@ -0,0 +1,128 @@ +--- +title: MultiQC v1.8 +date: 2019-11-20 +tags: [multiqc] +--- + +A huge release, this one has been a long time coming. Due to @ewels being away on paternity leave for over six months it was very delayed and has been nearly a year in the making! During that time there has been `344` commits with `3,370` lines of code added and `1,194` deletions by `19` contributors. That's a lot of changes. + +Highlights include: + +* Finally removing the annoying YAML warning +* Six new modules, and many large updates to existing modules +* Code restructuring allowing MultiQC to be imported into Python environments and easier running on Windows +* Lots of tiny bug fixes all over the place. + +Enjoy the update! And I promise I'll try not to make everyone wait so long for the next release... + +## Full changelog + +#### New Modules: +* [**fgbio**](http://fulcrumgenomics.github.io/fgbio/) + * Process family size count hist data from GroupReadsByUmi +* [**biobambam2**](https://github.com/gt1/biobambam2) + * Added submodule for `bamsormadup` tool + * Totally cheating - it uses Picard MarkDuplicates but with a custom search pattern and naming +* [**SeqyClean**](https://github.com/ibest/seqyclean) + * Adds analysis for seqyclean files +* [**mtnucratio**](https://github.com/apeltzer/MTNucRatioCalculator) + * Added little helper tool to compute mt to nuclear ratios for NGS data. +* [**mosdepth**](https://github.com/brentp/mosdepth) + * fast BAM/CRAM depth calculation for WGS, exome, or targeted sequencing +* [**SexDetErrmine**](https://github.com/TCLamnidis/Sex.DetERRmine) + * Relative coverage and error rate of X and Y chromosomes + +#### Module updates: +* **bcl2fastq** + * Added handling of demultiplexing of more than 2 reads + * Allow bcl2fastq to parse undetermined barcode information in situations when lane indexes do not start at 1 +* **BBMap** + * Support for scafstats output marked as not yet implemented in docs +* **DeDup** + * Added handling clusterfactor and JSON logfiles +* **damageprofiler** + * Added writing metrics to data output file. +* **DeepTools** + * Fixed Python3 bug with int() conversion ([#1057](https://github.com/ewels/MultiQC/issues/1057)) + * Handle varied TES boundary labels in plotProfile ([#1011](https://github.com/ewels/MultiQC/issues/1011)) + * Fixed bug that prevented running on only plotProfile files when no other deepTools files found. +* **fastp** + * Fix faulty column handling for the _after filtering_ Q30 rate ([#936](https://github.com/ewels/MultiQC/issues/936)) +* **FastQC** + * When including a FastQC section multiple times in one report, the Per Base Sequence Content heatmaps now behave as you would expect. + * Added heatmap showing FastQC status checks for every section report across all samples + * Made sequence content individual plots work after samples have been renamed ([#777](https://github.com/ewels/MultiQC/issues/777)) + * Highlighting samples from status - respect chosen highlight colour in the toolbox ([#742](https://github.com/ewels/MultiQC/issues/742)) +* **FastQ Screen** + * When including a FastQ Screen section multiple times in one report, the plots now behave as you would expect. +* **GATK** + * Refactored BaseRecalibrator code to be more consistent with MultiQC Python style + * Handle zero count errors in BaseRecalibrator +* **HiC Explorer** + * Fixed bug where module tries to parse QC_table.txt, a new log file in hicexplorer v2.2. +* **HTSeq** + * Fixed bug where module would crash if a sample had zero reads ([#1006](https://github.com/ewels/MultiQC/issues/1006)) +* **LongRanger** + * Added support for the LongRanger Align pipeline. +* **miRTrace** + * Fixed bug where a sample in some plots was missed. ([#932](https://github.com/ewels/MultiQC/issues/932)) +* **Peddy** + * Fixed bug where sample name cleaning could lead to error. ([#1024](https://github.com/ewels/MultiQC/issues/1024)) + * All plots (including _Het Check_ and _Sex Check_) now hidden if no data +* **Picard** + * Modified OxoGMetrics.py so that it will find files created with GATK CollectMultipleMetrics and ConvertSequencingArtifactToOxoG. +* **QoRTs** + * Fixed bug where `--dirs` broke certain input files. ([#821](https://github.com/ewels/MultiQC/issues/821)) +* **Qualimap** + * Added in mean coverage computation for general statistics report + * Creates now tables of collected data in `multiqc_data` +* **RNA-SeQC** + * Updated broken URL link +* **RSeQC** + * Fixed bug where Junction Saturation plot when clicking a single sample was mislabelling the lines. + * When including a RSeQC section multiple times in one report, clicking Junction Saturation plot now behaves as you would expect. + * Fixed bug where exported data in `multiqc_rseqc_read_distribution.txt` files had incorrect values for `_kb` fields ([#1017](https://github.com/ewels/MultiQC/issues/1017)) +* **Samtools** + * Utilize in-built `read_count_multiplier` functionality to plot `flagstat` results more nicely +* **SnpEff** + * Increased the default summary csv file-size limit from 1MB to 5MB. +* **Stacks** + * Fixed bug where multi-population sum stats are parsed correctly ([#906](https://github.com/ewels/MultiQC/issues/906)) +* **TopHat** + * Fixed bug where TopHat would try to run with files from Bowtie2 or HiSAT2 and crash +* **VCFTools** + * Fixed a bug where `tstv_by_qual.py` produced invalid json from infinity-values. +* **snpEff** + * Added plot of effects + + +#### New MultiQC Features: +* Added some installation docs for windows +* Added some docs about using MultiQC in bioinformatics pipelines +* Rewrote Docker image + * New base image `czentye/matplotlib-minimal` reduces image size from ~200MB to ~80MB + * Proper installation method ensures latest version of the code + * New entrypoint allows easier command-line usage +* Support opening MultiQC on websites with CSP `script-src 'self'` with some sha256 exceptions + * Plot data is no longer intertwined with javascript code so hashes stay the same +* Made `config.report_section_order` work for module sub-sections as well as just modules. +* New config options `exclude_modules` and `run_modules` to complement `-e` and `-m` cli flags. +* Command line output is now coloured by default :rainbow: (use `--no-ansi` to turn this off) +* Better launch comparability due to code refactoring by [@KerstenBreuer](https://github.com/KerstenBreuer) and [@ewels](https://github.com/ewels) + * Windows support for base `multiqc` command + * Support for running as a python module: `python -m multiqc .` + * Support for running within a script: `import multiqc` and `multiqc.run('/path/to/files')` +* Config option `custom_plot_config` now works for bargraph category configs as well ([#1044](https://github.com/ewels/MultiQC/issues/1044)) +* Config `table_columns_visible` can now be given a module namespace and it will hide all columns from that module ([#541](https://github.com/ewels/MultiQC/issues/541)) + +#### Bug Fixes: +* MultiQC now ignores all `.md5` files +* Use `SafeLoader` for PyYaml load calls, avoiding recent warning messages. +* Hide `multiqc_config_example.yaml` in the `test` directory to stop people from using it without modification. +* Fixed matplotlib background colour issue (@epakarin - [#886](https://github.com/ewels/MultiQC/issues)) +* Table rows that are empty due to hidden columns are now properly hidden on page load ([#835](https://github.com/ewels/MultiQC/issues/835)) +* Sample name cleaning: All sample names are now truncated to their basename, without a path. + * This includes for `regex` and `replace` (before was only the default `truncate`). + * Only affects modules that take sample names from file contents, such as cutadapt. + * See [#897](https://github.com/ewels/MultiQC/issues/897) for discussion. + diff --git a/changelog/multiqc/v1.9.mdx b/changelog/multiqc/v1.9.mdx new file mode 100644 index 000000000..6f2795caa --- /dev/null +++ b/changelog/multiqc/v1.9.mdx @@ -0,0 +1,184 @@ +--- +title: MultiQC v1.9 +date: 2020-05-30 +tags: [multiqc] +--- + +Another massive release - many thanks to all of the contributors! Keep those pull-requests and issues coming! + +# Dropped official support for Python 2 + +Python 2 had its [official sunset date](https://www.python.org/doc/sunset-python-2/) +on January 1st 2020, meaning that it will no longer be developed by the Python community. +Part of the [python.org statement](https://www.python.org/doc/sunset-python-2/) reads: + +> That means that we will not improve it anymore after that day, +> even if someone finds a security problem in it. +> You should upgrade to Python 3 as soon as you can. + +[Very many Python packages no longer support Python 2](https://python3statement.org/) +and it whilst the MultiQC code is currently compatible with both Python 2 and Python 3, +it is increasingly difficult to maintain compatibility with the dependency packages it +uses, such as MatPlotLib, numpy and more. + +As of MultiQC version 1.9, **Python 2 is no longer officially supported**. +Automatic CI tests will no longer run with Python 2 and Python 2 specific workarounds +are no longer guaranteed. + +Whilst it may be possible to continue using MultiQC with Python 2 for a short time by +pinning dependencies, MultiQC compatibility for Python 2 will now slowly drift and start +to break. If you haven't already, **you need to switch to Python 3 now**. + +# New MultiQC Features + +* Now using [GitHub Actions](https://github.com/features/actions) for all CI testing + * Dropped Travis and AppVeyor, everything is now just on GitHub + * Still testing on both Linux and Windows, with multiple versions of Python + * CI tests should now run automatically for anyone who forks the MultiQC repository +* Linting with `--lint` now checks line graphs as well as bar graphs +* New `gathered` template with no tool name sections ([#1119](https://github.com/ewels/MultiQC/issues/1119)) +* Added `--sample-filters` option to add _show_/_hide_ buttons at the top of the report ([#1125](https://github.com/ewels/MultiQC/issues/1125)) + * Buttons control the report toolbox Show/Hide tool, filtering your samples + * Allows reports to be pre-configured based on a supplied list of sample names at report-generation time. +* Line graphs can now have `Log10` buttons (same functionality as bar graphs) +* Importing and running `multiqc` in a script is now a _little_ Better + * `multiqc.run` now returns the `report` and `config` as well as the exit code. This means that you can explore the MultiQC run time a little in the Python environment. + * Much more refactoring is needed to make MultiQC as useful in Python scripts as it could be. Watch this space. +* If a custom module `anchor` is set using `module_order`, it's now used a bit more: + * Prefixed to module _section_ IDs + * Appended to files saved in `multiqc_data` + * Should help to prevent duplicates requiring `-1` suffixes when running a module multiple times +* New heatmap plot config options `xcats_samples` and `ycats_samples` + * If set to `False`, the report toolbox options (_highlight_, _rename_, _show/hide_) do not affect that axis. + * Means that the _Show only matching samples_ report toolbox option works on FastQC Status Checks, for example ([#1172](https://github.com/ewels/MultiQC/issues/1172)) +* Report header time and analysis paths can now be hidden + * New config options `show_analysis_paths` and `show_analysis_time` ([#1113](https://github.com/ewels/MultiQC/issues/1113)) +* New search pattern key `skip: true` to skip specific searches when modules look for a lot of different files (eg. Picard). +* New `--profile-runtime` command line option (`config.profile_runtime`) to give analysis of how long the report takes to be generated + * Plots of the file search results and durations are added to the end of the MultiQC report as a special module called _Run Time_ + * A summary of the time taken for the major stages of MultiQC execution are printed to the command line log. +* New table config option `only_defined_headers` + * Defaults to `true`, set to `false` to also show any data columns that are not defined as headers + * Useful as allows table-wide defaults to be set with column-specific overrides +* New `module` key allowed for `config.extra_fn_clean_exts` and `config.fn_clean_exts` + * Means you can limit the action of a sample name cleaning pattern to specific MultiQC modules ([#905](https://github.com/ewels/MultiQC/issues/905)) + +# New Custom Content features + +* Improve support for HTML files - now just end your HTML filename with `_mqc.html` + * Native handling of HTML snippets as files, no MultiQC config or YAML file required. + * Also with embedded custom content configuration at the start of the file as a HTML comment. +* Add ability to group custom-content files into report sections + * Use the new `parent_id`, `parent_name` and `parent_description` config keys to group content together like a regular module ([#1008](https://github.com/ewels/MultiQC/issues/1008)) +* Custom Content files can now be configured using `custom_data`, without giving search patterns or data + * Allows you to set descriptions and nicer titles for images and other 'blunt' data types in reports ([#1026](https://github.com/ewels/MultiQC/issues/1026)) + * Allows configuration of custom content separately from files themselves (`tsv`, `csv`, `txt` formats) ([#1205](https://github.com/ewels/MultiQC/issues/1205)) + +# New Modules: + +* [**DRAGEN**](https://www.illumina.com/products/by-type/informatics-products/dragen-bio-it-platform.html) + * Illumina Bio-IT Platform that uses FPGA for secondary NGS analysis +* [**iVar**](https://github.com/andersen-lab/ivar) + * Added support for iVar: a computational package that contains functions broadly useful for viral amplicon-based sequencing. +* [**Kaiju**](http://kaiju.binf.ku.dk/) + * Fast and sensitive taxonomic classification for metagenomics +* [**Kraken**](https://ccb.jhu.edu/software/kraken2/) + * K-mer matching tool for taxonomic classification. Module plots bargraph of counts for top-5 hits across each taxa rank. General stats summary. +* [**MALT**](https://uni-tuebingen.de/fakultaeten/mathematisch-naturwissenschaftliche-fakultaet/fachbereiche/informatik/lehrstuehle/algorithms-in-bioinformatics/software/malt/) + * Megan Alignment Tool: Metagenomics alignment tool. +* [**miRTop**](https://github.com/miRTop/mirtop) + * Command line tool to annotate miRNAs with a standard mirna/isomir naming (mirGFF3) + * Module started by [@oneillkza](https://github.com/oneillkza/) and completed by [@FlorianThibord](https://github.com/FlorianThibord/) +* [**MultiVCFAnalyzer**](https://github.com/alexherbig/multivcfanalyzer) + * Combining multiple VCF files into one coherent report and format for downstream analysis. +* **Picard** - new submodules for `QualityByCycleMetrics`, `QualityScoreDistributionMetrics` & `QualityYieldMetrics` + * See [#1116](https://github.com/ewels/MultiQC/issues/1114) +* [**Rockhopper**](https://cs.wellesley.edu/~btjaden/Rockhopper/) + * RNA-seq tool for bacteria, includes bar plot showing where features map. +* [**Sickle**](https://github.com/najoshi/sickle) + * A windowed adaptive trimming tool for FASTQ files using quality +* [**Somalier**](https://github.com/brentp/somalier) + * Relatedness checking and QC for BAM/CRAM/VCF for cancer, DNA, BS-Seq, exome, etc. +* [**VarScan2**](https://github.com/dkoboldt/varscan) + * Variant calling and somatic mutation/CNV detection for next-generation sequencing data + +# Module updates: + +* **BISCUIT** + * Major rewrite to work with new BISCUIT QC script (BISCUIT `v0.3.16+`) + * This change breaks backwards-compatability with previous BISCUIT versions. If you are unable to upgrade BISCUIT, please use MultiQC v1.8. + * Fixed error when missing data in log files ([#1101](https://github.com/ewels/MultiQC/issues/1101)) +* **bcl2fastq** + * Samples with multiple library preps (i.e barcodes) will now be handled correctly ([#1094](https://github.com/ewels/MultiQC/issues/1094)) +* **BUSCO** + * Updated log search pattern to match new format in v4 with auto-lineage detection option ([#1163](https://github.com/ewels/MultiQC/issues/1163)) +* **Cutadapt** + * New bar plot showing the proportion of reads filtered out for different criteria (eg. _too short_, _too many Ns_) ([#1198](https://github.com/ewels/MultiQC/issues/1198)) +* **DamageProfiler** + * Removes redundant typo in init name. This makes referring to the module's column consistent with other modules when customising general stats table. +* **DeDup** + * Updates plots to make compatible with 0.12.6 + * Fixes reporting errors - barplot total represents _mapped_ reads, not total reads in BAM file + * New: Adds 'Post-DeDup Mapped Reads' column to general stats table. +* **FastQC** + * Fixed tooltip text in _Sequence Duplication Levels_ plot ([#1092](https://github.com/ewels/MultiQC/issues/1092)) + * Handle edge-case where a FastQC report was for an empty file with 0 reads ([#1129](https://github.com/ewels/MultiQC/issues/1129)) +* **FastQ Screen** + * Don't skip plotting `% No Hits` even if it's `0%` ([#1126](https://github.com/ewels/MultiQC/issues/1126)) + * Refactor parsing code. Avoids error with `-0.00 %Unmapped` ([#1126](https://github.com/ewels/MultiQC/issues/1126)) + * New plot for _Bisulfite Reads_, if data is present + * Categories in main plot are now sorted by the total read count and hidden if 0 across all samples +* **fgbio** + * New: Plot error rate by read position from `ErrorRateByReadPosition` + * GroupReadsByUmi plot can now be toggled to show relative percents ([#1147](https://github.com/ewels/MultiQC/pull/1147)) +* **FLASh** + * Logs not reporting innie and outine uncombined pairs now plot combined pairs instead ([#1173](https://github.com/ewels/MultiQC/issues/1173)) +* **GATK** + * Made parsing for VariantEval more tolerant, so that it will work with output from the tool when run in different modes ([#1158](https://github.com/ewels/MultiQC/issues/1158)) +* **MTNucRatioCalculator** + * Fixed misleading value suffix in general stats table +* **Picard MarkDuplicates** + * **Major change** - previously, if multiple libraries (read-groups) were found then only the first would be used and all others ignored. Now, values from all libraries are merged and `PERCENT_DUPLICATION` and `ESTIMATED_LIBRARY_SIZE` are recalculated. Libraries can be kept as separate samples with a new MultiQC configuration option - `picard_config: markdups_merge_multiple_libraries: False` + * **Major change** - Updated `MarkDuplicates` bar plot to double the read-pair counts, so that the numbers stack correctly. ([#1142](https://github.com/ewels/MultiQC/issues/1142)) +* **Picard HsMetrics** + * Updated large table to use columns specified in the MultiQC config. See [docs](https://multiqc.info/docs/#hsmetrics). ([#831](https://github.com/ewels/MultiQC/issues/831)) +* **Picard WgsMetrics** + * Updated parsing code to recognise new java class string ([#1114](https://github.com/ewels/MultiQC/issues/1114)) +* **QualiMap** + * Fixed QualiMap mean coverage calculation [#1082](https://github.com/ewels/MultiQC/issues/1082), [#1077](https://github.com/ewels/MultiQC/issues/1082) +* **RSeqC** + * Support added for output from `geneBodyCoverage2.py` script ([#844](https://github.com/ewels/MultiQC/issues/844)) + * Single sample view in the _"Junction saturation"_ plot now works with the toolbox properly _(rename, hide, highlight)_ ([#1133](https://github.com/ewels/MultiQC/issues/1133)) +* **RNASeQC2** + * Updated to handle the parsing metric files from the [newer rewrite of RNA-SeqQC](https://github.com/broadinstitute/rnaseqc). +* **Samblaster** + * Improved parsing to handle variable whitespace ([#1176](https://github.com/ewels/MultiQC/issues/1176)) +* **Samtools** + * Removes hardcoding of general stats column names. This allows column names to indicate when a module has been run twice ([https://github.com/ewels/MultiQC/issues/1076](https://github.com/ewels/MultiQC/issues/1076)). + * Added an observed over expected read count plot for `idxstats` ([#1118](https://github.com/ewels/MultiQC/issues/1118)) + * Added additional (by default hidden) column for `flagstat` that displays number total number of reads in a bam +* **sortmerna** + * Fix the bug for the latest sortmerna version 4.2.0 ([#1121](https://github.com/ewels/MultiQC/issues/1121)) +* **sexdeterrmine** + * Added a scatter plot of relative X- vs Y-coverage to the generated report. +* **VerifyBAMID** + * Allow files with column header `FREEMIX(alpha)` ([#1112](https://github.com/ewels/MultiQC/issues/1112)) + +# Bug Fixes: + +* Added a new test to check that modules work correctly with `--ignore-samples`. A lot of them didn't: + * `Mosdepth`, `conpair`, `Qualimap BamQC`, `RNA-SeQC`, `GATK BaseRecalibrator`, `SNPsplit`, `SeqyClean`, `Jellyfish`, `hap.py`, `HOMER`, `BBMap`, `DeepTools`, `HiCExplorer`, `pycoQC`, `interop` + * These modules have now all been fixed and `--ignore-samples` should work as you expect for whatever data you have. +* Removed use of `shutil.copy` to avoid problems with working on multiple filesystems ([#1130](https://github.com/ewels/MultiQC/issues/1130)) +* Made folder naming behaviour of `multiqc_plots` consistent with `multiqc_data` + * Incremental numeric suffixes now added if folder already exists + * Plots folder properly renamed if using `-n`/`--filename` +* Heatmap plotting function is now compatible with MultiQC toolbox `hide` and `highlight` ([#1136](https://github.com/ewels/MultiQC/issues/1136)) +* Plot config `logswitch_active` now works as advertised +* When running MultiQC modules several times, multiple data files are now created instead of overwriting one another ([#1175](https://github.com/ewels/MultiQC/issues/1175)) +* Fixed minor bug where tables could report negative numbers of columns in their header text +* Fixed bug where numeric custom content sample names could trigger a `TypeError` ([#1091](https://github.com/ewels/MultiQC/issues/1091)) +* Fixed custom content bug HTML data in a config file would trigger a `ValueError` ([#1071](https://github.com/ewels/MultiQC/issues/1071)) +* Replaced deprecated 'warn()' with 'warning()' of the logging module +* Custom content now supports `section_extra` config key to add custom HTML after description. +* Barplots with `ymax` set now ignore this when you click the _Percentages_ tab. diff --git a/changelog/nextflow/v0.10.0.mdx b/changelog/nextflow/v0.10.0.mdx new file mode 100644 index 000000000..18d9d83b7 --- /dev/null +++ b/changelog/nextflow/v0.10.0.mdx @@ -0,0 +1,22 @@ +--- +title: Nextflow v0.10.0 +date: 2014-09-08 +tags: [nextflow] +--- + +0.10.0 - 8 Sept 2014 +- Added DRMAA executor +- Added PBS/Torque executor +- Added processes execution report +- Added Extrae tracing support +- Added support for GitHub private repositories +- Added integration for BitBucket hosted repositories (Git vcs only) +- Added native integration AWS S3 file system +- Improved Docker support and configuration +- Improved GridGain cluster integration +- Removed Hazelcast integration +- Added Capsule based application packaging +- Added commands + view: that prints the content a pipeline repository + config: shows pipeline configuration +- Fixed issue #12 - Error resuming process with command defined on multiple lines diff --git a/changelog/nextflow/v0.10.1.mdx b/changelog/nextflow/v0.10.1.mdx new file mode 100644 index 000000000..8ac128361 --- /dev/null +++ b/changelog/nextflow/v0.10.1.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.10.1 +date: 2014-09-15 +tags: [nextflow] +--- + +- Added ability to 'run' implicitly a script when it's specified as the very first parameter (for backward compatibility) +- Added 'workDir' and 'baseDir' implicit variables in configuration files +- Fixed docker remove issue by executing as an external command +- Fixed an issue when finding the longest common path used by docker mounts +- Fixed issue #13 - Show a detailed error message when hitting GitHub rate limits diff --git a/changelog/nextflow/v0.10.2.mdx b/changelog/nextflow/v0.10.2.mdx new file mode 100644 index 000000000..a29902daf --- /dev/null +++ b/changelog/nextflow/v0.10.2.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.10.2 +date: 2014-10-01 +tags: [nextflow] +--- + +- Fixed bug while submitting a job to SLURM scheduler due to special characters in job name +- Fixed bug in TaskConfig#toBool() method +- Fixed bug resolving configuration file when pipeline script is a symlink +- Fixed bug while setting 'workDir' attribute on PBS job executor +- Improved error message when the name of a process is missing +- Removed TaskConfig#getMerge() method +- Updated method Channel.fromPath(String) so that it returns normalised absolute paths +- Updated Capsule to version 0.9.0 stable +- Fixed typos in documentation diff --git a/changelog/nextflow/v0.10.3.mdx b/changelog/nextflow/v0.10.3.mdx new file mode 100644 index 000000000..b2e0640ff --- /dev/null +++ b/changelog/nextflow/v0.10.3.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.10.3 +date: 2014-10-03 +tags: [nextflow] +--- + +- Fixed bug when composing SLURM 'squeue' command line which was containing + unnecessary quote characters thus invalidating the jobs status check mechanism diff --git a/changelog/nextflow/v0.11.0.mdx b/changelog/nextflow/v0.11.0.mdx new file mode 100644 index 000000000..40ece3c53 --- /dev/null +++ b/changelog/nextflow/v0.11.0.mdx @@ -0,0 +1,17 @@ +--- +title: Nextflow v0.11.0 +date: 2014-11-05 +tags: [nextflow] +--- + +- Added sorting ability to collectFile operator +- Added new 'cpus', 'memory', 'time', 'penv' process directives +- Added cpu, memory and I/O resources in execution tracing report +- Upgraded to groovy 2.3.7 +- Relaxed validation check of -resume option +- Fixed symlink support to Github and BitBucket shared repositories +- Fixed Channel.fromPath with S3 path +- Enhanced error reporting +- Removed blanks from jobs name +- Added NXF_ASSEST environment variable +- Added NXF_TEMP environment variable to define local temporary path diff --git a/changelog/nextflow/v0.11.1.mdx b/changelog/nextflow/v0.11.1.mdx new file mode 100644 index 000000000..2552f474c --- /dev/null +++ b/changelog/nextflow/v0.11.1.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.11.1 +date: 2014-11-11 +tags: [nextflow] +--- + +- Fixed serialisation issue on pipeline resume +- Fixed issue on command line parameters with no arg (flag) +- Refactored class HubOptions to a trait diff --git a/changelog/nextflow/v0.11.2.mdx b/changelog/nextflow/v0.11.2.mdx new file mode 100644 index 000000000..16b3a604b --- /dev/null +++ b/changelog/nextflow/v0.11.2.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.11.2 +date: 2014-11-19 +tags: [nextflow] +--- + +- Added 'groupTuple' operator +- Added NXF_WORK variable to define default scratch path +- Added Gzip un-compress ability to splitter operators +- Added 'limit' parameter to splitter operators +- Added 'meta' parameter to splitter operators +- Field 'walltime' has been renamed to 'realtime' in tracing file +- Fixed issue on 'collectFile' operator when no 'name' parameter is specified +- Removed dependency on Picard library +- Improved error reporting diff --git a/changelog/nextflow/v0.11.3.mdx b/changelog/nextflow/v0.11.3.mdx new file mode 100644 index 000000000..12fd39307 --- /dev/null +++ b/changelog/nextflow/v0.11.3.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.11.3 +date: 2014-11-27 +tags: [nextflow] +--- + +- Added to splitters ability to save chunks to files +- Fixed a bug that prevented an error message to be reported when using a missing variable in the process script +- Improved info command showing local and remote branches +- Improved error report when failing to delete pipeline directory +- Removed gpars methods implicit imports +- Fixed unit for 'syscr' and 'syscw' fields in trace report +- Upgraded JGit library version to 3.5.2.201411120430-r diff --git a/changelog/nextflow/v0.11.4.mdx b/changelog/nextflow/v0.11.4.mdx new file mode 100644 index 000000000..2ddf42a57 --- /dev/null +++ b/changelog/nextflow/v0.11.4.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.11.4 +date: 2014-12-16 +tags: [nextflow] +--- + +- Fixed issue in TextFileCollector empty condition that was creating a empty split file + when the split size was equals to the number or records +- Fixed bug that prevents a job is added to the polling queue when submit operation fails +- Fixed issue #24 -- Http/s proxy environment variables are not used properly +- Added more strict checks on $JAVA_CMD executable and $JAVA_HOME folder +- Upgraded to Groovy 2.3.8 diff --git a/changelog/nextflow/v0.12.0.mdx b/changelog/nextflow/v0.12.0.mdx new file mode 100644 index 000000000..ed9fb0bfb --- /dev/null +++ b/changelog/nextflow/v0.12.0.mdx @@ -0,0 +1,21 @@ +--- +title: Nextflow v0.12.0 +date: 2015-01-05 +tags: [nextflow] +--- + +- Added afterScript/beforeScript directives +- Added tag directive to label task executions with a custom identifier +- Added dynamic directives evaluation +- Added support for dynamic input/output file names with closures +- Added `ifEmpty` operator +- Added `view` operator +- Added `remainder` optional parameter to `phase` operator +- Removed 'undef' directive +- Refactored grid executors so that jobs directives are added on top of script wrapper +- Renamed ContextMap to TaskContext +- Renamed TaskConfig to ProcessConfig +- Renamed LocalConfig to TaskConfig +- Shared process declaration has been deprecated +- Print pid/hostname in the status log +- Upgraded to Groovy 2.3.9 and Slf4j 1.7.8 diff --git a/changelog/nextflow/v0.12.1.mdx b/changelog/nextflow/v0.12.1.mdx new file mode 100644 index 000000000..5856f10b6 --- /dev/null +++ b/changelog/nextflow/v0.12.1.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.12.1 +date: 2015-02-08 +tags: [nextflow] +--- + +- Fixed NoSuchMethodException issue on Java 1.7.0_01 due to missing private constructor +- Fixed logging issue on Nextflow console +- Fixed issue `view` operator which hung when used on a dataflow variable +- Upgrade SLF4J to version 1.7.10 +- Upgrade Capsule to version 0.10.0 +- Removed dependency on jsr166y module +- Removed `synchronized` declaration on Session cleanUp method diff --git a/changelog/nextflow/v0.12.2.mdx b/changelog/nextflow/v0.12.2.mdx new file mode 100644 index 000000000..f739242c9 --- /dev/null +++ b/changelog/nextflow/v0.12.2.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.12.2 +date: 2015-02-12 +tags: [nextflow] +--- + +- Fixed issue on some SGE implementation where `-terse` directive in job script is not working +- Downgrade Capsule to 0.9.0 due to an issue in version 0.10.0 - https://github.com/puniverse/capsule/issues/56 diff --git a/changelog/nextflow/v0.12.3.mdx b/changelog/nextflow/v0.12.3.mdx new file mode 100644 index 000000000..3804dc814 --- /dev/null +++ b/changelog/nextflow/v0.12.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.12.3 +date: 2015-02-16 +tags: [nextflow] +--- + +- Added support for `module` and `container` fields in execution trace log +- Fixed a small inconsistency on polling monitor queue size for local executor when using single core or two-cores cpu +- Enhanced process key generation including global variables referenced in the process scope +- Enhanced `sum` operator and added `mean` operator diff --git a/changelog/nextflow/v0.12.4.mdx b/changelog/nextflow/v0.12.4.mdx new file mode 100644 index 000000000..ea99a982c --- /dev/null +++ b/changelog/nextflow/v0.12.4.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.12.4 +date: 2015-03-09 +tags: [nextflow] +--- + +- Added suspended job status handling to SLURM executor -- Issue #36 +- Added `print` and `println` operators plus tests and updated docs +- Fixed issue on `view` operator when specifying a closure +- Fixed Docker image resource request in `crg` executor +- Improved task hash key generation and task variables handling +- Compute `baseDir` and `workDir` as string values when creating task unique hash +- Improved `sum` operator to allows it to handle lists with varying size +- Upgrading Groovy runtime to version 2.3.10 diff --git a/changelog/nextflow/v0.12.5.mdx b/changelog/nextflow/v0.12.5.mdx new file mode 100644 index 000000000..dfec445d9 --- /dev/null +++ b/changelog/nextflow/v0.12.5.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.12.5 +date: 2015-03-18 +tags: [nextflow] +--- + +- Fixed regression preventing jobs cleanup when nextflow process is killed +- Fixed issue when command line flag has not value making it to consume following option +- Added `uge` executor as alias of SgeExecutor class +- Upgraded Spock testing library to version 1.0 +- Improved log messages diff --git a/changelog/nextflow/v0.13.0.mdx b/changelog/nextflow/v0.13.0.mdx new file mode 100644 index 000000000..84a45caca --- /dev/null +++ b/changelog/nextflow/v0.13.0.mdx @@ -0,0 +1,27 @@ +--- +title: Nextflow v0.13.0 +date: 2015-04-08 +tags: [nextflow] +--- + +- Added support for AWS S3 storage +- Added support for ClusterK Cirrus cloud scheduler +- Added multiple debugging level in command scripts by using `NXF_DEBUG` variable +- Added ability to disable docker kill command +- Added explicit `entrypoint` definition in docker run command +- Added `uge` executor as alias of SgeExecutor class +- Added `-D` JVM properties command line option +- Added `.command.log` to grid executors +- Separated `stdout` and `stderr` outputs +- Refactored DRMAA executor to a separate sub-project +- Refactored application packaging based on Capsule modes +- Refactored application installer downloading dependencies at runtime +- Optimised file attributes access usage +- Increased log and trace files rolling max index to 9 +- Print revision and commit ID on pipeline startup +- Improved handling of docker cpuset for `crg` executor +- Improved TraceFileObserver to flush written content +- Improved `info ` command with `-d` option that shows git revision commit IDs +- Fixed issue #39 - Per process containers not working with -with-docker option +- Upgraded Groovy runtime to version 2.3.11 +- Upgraded Logback library to version 1.1.3 diff --git a/changelog/nextflow/v0.13.1.mdx b/changelog/nextflow/v0.13.1.mdx new file mode 100644 index 000000000..76f233b16 --- /dev/null +++ b/changelog/nextflow/v0.13.1.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.13.1 +date: 2015-04-11 +tags: [nextflow] +--- + +- Fixed `IllegalStateException` when executing a script in Nextflow console diff --git a/changelog/nextflow/v0.13.2.mdx b/changelog/nextflow/v0.13.2.mdx new file mode 100644 index 000000000..1b62b055a --- /dev/null +++ b/changelog/nextflow/v0.13.2.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.13.2 +date: 2015-04-16 +tags: [nextflow] +--- + +- Handle staging in the local process directory of files on remote/foreign file systems +- Fixed issue in resources stats tracing script -- awk uses scientific notation for numbers instead of decimal format. +- Fixed external links to Groovy docs +- Fixed issue #40 -- Cannot find java binary on Mac OSX +- Fixed missing `DynamicParameter` in usage string +- Fixed docker run `—-cpuset` command line option when using `crg` executor diff --git a/changelog/nextflow/v0.13.3.mdx b/changelog/nextflow/v0.13.3.mdx new file mode 100644 index 000000000..76e21168e --- /dev/null +++ b/changelog/nextflow/v0.13.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.13.3 +date: 2015-04-19 +tags: [nextflow] +--- + +- Fixed issue when staging file when using a non local pipeline workdir +- Fixed invalid values in the trace file returned by `awk` +- Removed unnecessary `S3Path` serialiser registation on DnaNexus executor initialisation +- Updated S3 file system client to version 0.2.8g diff --git a/changelog/nextflow/v0.13.4.mdx b/changelog/nextflow/v0.13.4.mdx new file mode 100644 index 000000000..b30fd97b8 --- /dev/null +++ b/changelog/nextflow/v0.13.4.mdx @@ -0,0 +1,21 @@ +--- +title: Nextflow v0.13.4 +date: 2015-05-04 +tags: [nextflow] +--- + +- Added html processes execution time report +- Added support for Docker executable containers - Feature #33 +- Added support for missing number types to CacheHelper +- Added warning message when using a deprecated input/output shared parameter +- Fixed issue causing process hangs when stdout+stderr is bigger than 64K when using local executor +- Fixed process stdout/stderr synchronisation issue +- Fixed race condition when accessing `processor` attribute - Issue #41 +- Fixed race condition on processes registration/termination - See issue #43 +- Fixed `echo` synchronisation strategy when writing to stdout +- Use a fixed thread pool for tasks execution and keep it separated from Gpars thread pool +- Do not set Gpars thread pool size along with nextflow pool size +- Improved resolution to tenths of a second when converting a `Duration` to string +- Removed unnecessary local scope map argument from `getTaskGlobalVars` method +- Read trace file w/o checking existence in order to reduce round-trip on remote storage +- Workaround for Groovy compiler issue GROOVY-7409 diff --git a/changelog/nextflow/v0.13.5.mdx b/changelog/nextflow/v0.13.5.mdx new file mode 100644 index 000000000..34d62ceb0 --- /dev/null +++ b/changelog/nextflow/v0.13.5.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.13.5 +date: 2015-05-07 +tags: [nextflow] +--- + +- Fixed issue #44 - Pipeline hangs when `map` operator is applied to a dataflow variable diff --git a/changelog/nextflow/v0.14.0.mdx b/changelog/nextflow/v0.14.0.mdx new file mode 100644 index 000000000..5bc9c4c34 --- /dev/null +++ b/changelog/nextflow/v0.14.0.mdx @@ -0,0 +1,33 @@ +--- +title: Nextflow v0.14.0 +date: 2015-06-04 +tags: [nextflow] +--- + +- Added support for file templates in process definition +- Added process `when` guard for conditional execution +- Added process `shell` block that allows both BASH and Groovy variables in the same script block +- Added support for includes in configuration files +- Added support for profiles in configuration files +- Added channel operator `set { }` +- Added channel operator `into { }` +- Added channel operator `tap { }` +- Added channel method `close()` +- Added channel factory `value()` +- Added `fixOwnership` docker config option +- Added `unstageStrategy` process config option +- Added minlog-slf4j kryo logging redirection +- Added `ext` directive for user defined configuration properties +- Added support for multi-indices grouping key to `groupTuple` operator +- Added support for unlimited `maxErrors` when set to `-1` - Issue #46 +- Fixed issue that caused task attribute to be lost when resuming execution +- Fixed pipeline hangs when `map` operator is applied to a dataflow variables - Issue #44 +- Fixed pipeline hangs when `into` operator is applied to a dataflow variable +- Improved dynamic code compilation with `Grengine` module +- Increased default queue size to 100 tasks when using a grid executor +- Refactored `Session` to remove dependency with `CmdRun` object Added ability to set `workDir` in the config file +- New implicit lazy Gstring in process parameter and directive definitions +- Changed file unstage strategy using `cp` command instead of `rsync` +- Removed `workDir` variable from config file +- Updated JGit to version 3.7.1 +- Updated Slf4j to version 1.7.12 diff --git a/changelog/nextflow/v0.14.1.mdx b/changelog/nextflow/v0.14.1.mdx new file mode 100644 index 000000000..57bbf14e4 --- /dev/null +++ b/changelog/nextflow/v0.14.1.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.14.1 +date: 2015-06-08 +tags: [nextflow] +--- + +- Strip colon character from grid task name +- Fixed synchronisation issue that caused pipeline hung when execution was aborted +- Fixed an issue raising a MissingPropertyException when a script global variable was referenced in a process `shell` block diff --git a/changelog/nextflow/v0.14.2.mdx b/changelog/nextflow/v0.14.2.mdx new file mode 100644 index 000000000..449badc9f --- /dev/null +++ b/changelog/nextflow/v0.14.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.14.2 +date: 2015-06-25 +tags: [nextflow] +--- + +- Fixed issue #48 - IncludeConfig does not support dot properties syntax +- Fixed issue #49 - GridGain executor raises a NPE exception when launching a native process +- Fixed issue #52 - Method `moveTo` should not throw a `FileAlreadyExistsException` when target file already exists diff --git a/changelog/nextflow/v0.14.3.mdx b/changelog/nextflow/v0.14.3.mdx new file mode 100644 index 000000000..187c9ca71 --- /dev/null +++ b/changelog/nextflow/v0.14.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.14.3 +date: 2015-07-03 +tags: [nextflow] +--- + +- Fixed issue #53 - Cannot access files list entry by using square bracket syntax diff --git a/changelog/nextflow/v0.14.4.mdx b/changelog/nextflow/v0.14.4.mdx new file mode 100644 index 000000000..f2d3d617a --- /dev/null +++ b/changelog/nextflow/v0.14.4.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.14.4 +date: 2015-07-20 +tags: [nextflow] +--- + +- Fixed issue #54 - Nextflow installer does not work when running behind a proxy server +- Upgraded Capsule package manager to version 1.0-rc2 diff --git a/changelog/nextflow/v0.15.0.mdx b/changelog/nextflow/v0.15.0.mdx new file mode 100644 index 000000000..1a556fa9a --- /dev/null +++ b/changelog/nextflow/v0.15.0.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.15.0 +date: 2015-07-27 +tags: [nextflow] +--- + +- Issue #56 - Added method `all()` to params object +- Issue #57 - Processes having identical commands and inputs are given the same hash key +- Issue #59 - Enhanced output `val` declaration adding support for value literals and value expressions +- Fixed minor issue when deleting pipeline repo with `drop` command +- Removed deprecated `share` process clause +- Updated JGit to version 4.0.1 diff --git a/changelog/nextflow/v0.15.1.mdx b/changelog/nextflow/v0.15.1.mdx new file mode 100644 index 000000000..c2a80e5b5 --- /dev/null +++ b/changelog/nextflow/v0.15.1.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.15.1 +date: 2015-08-04 +tags: [nextflow] +--- + +- Added feature #60 - Implements support for Gitlab source code management platform. +- Added support for `disk` directive to `crg` executor. +- Fixed issue #57 - Creation folder lock must be a singleton instance. +- Fixed issue #62 - Operator hangs for negative values or when it is greater or equals to the total number of emitted items. +- Fixed an exception when output file is specified with variable identifier e.g. `output: file(x) into channel` diff --git a/changelog/nextflow/v0.15.2.mdx b/changelog/nextflow/v0.15.2.mdx new file mode 100644 index 000000000..4aca28450 --- /dev/null +++ b/changelog/nextflow/v0.15.2.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v0.15.2 +date: 2015-08-19 +tags: [nextflow] +--- + +- Improved `groupTuple` operator adding the support of `size` and `remainder` parameters. +- Fixed issue #47. Creation of scratch folder on Mac OS-X. +- Fixed issue #64. `Channel.fromPath` throws an exception when curly brackets glob pattern is used with a S3 path. +- Fixed issue #65. An input file that is staged from a foreign file system lost it's original name. +- Fixed issue #66. Git submodules are not cloned/updated when a pipeline project is pulled from a remote repository. +- Fixed minor issue when evaluating config lazy property with no binding object. +- Updated Capsule to latest version () fixing an issue that was preventing to add a custom path to the application classpath. +- Added Path matches extension method [experimental]. +- Added support for `into` parameter to `splitXxx` operators. +- Changed signature of `close` operator so that it returns the channel to which it is applied. diff --git a/changelog/nextflow/v0.15.3.mdx b/changelog/nextflow/v0.15.3.mdx new file mode 100644 index 000000000..3081d2ba1 --- /dev/null +++ b/changelog/nextflow/v0.15.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.15.3 +date: 2015-08-26 +tags: [nextflow] +--- + +- Merged #68. Add `engineOptions` setting to Docker configuration. diff --git a/changelog/nextflow/v0.15.4.mdx b/changelog/nextflow/v0.15.4.mdx new file mode 100644 index 000000000..af276531a --- /dev/null +++ b/changelog/nextflow/v0.15.4.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.15.4 +date: 2015-09-23 +tags: [nextflow] +--- + +- Fixed #72. Adding cache support for `collectFile` operator. +- Added experimental operator `until` +- Added `self-update` in the command usage help +- Updated Capsule to version 1.0 +- Updated to Gradle 2.7 diff --git a/changelog/nextflow/v0.15.5.mdx b/changelog/nextflow/v0.15.5.mdx new file mode 100644 index 000000000..2769efa69 --- /dev/null +++ b/changelog/nextflow/v0.15.5.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.15.5 +date: 2015-09-28 +tags: [nextflow] +--- + +- Fixed #74. Operator "spread" hangs when it is applied to a singleton channel. diff --git a/changelog/nextflow/v0.15.6.mdx b/changelog/nextflow/v0.15.6.mdx new file mode 100644 index 000000000..9b2ee4670 --- /dev/null +++ b/changelog/nextflow/v0.15.6.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.15.6 +date: 2015-10-07 +tags: [nextflow] +--- + +- Fixed #78. Command line parsing of parameters does not handle some strings properly. +- Fixed #80. Command line argument containing a glob pattern is expanded even when escaped or enclosed in quote characters. diff --git a/changelog/nextflow/v0.16.0-RC1.mdx b/changelog/nextflow/v0.16.0-RC1.mdx new file mode 100644 index 000000000..6b3db027c --- /dev/null +++ b/changelog/nextflow/v0.16.0-RC1.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.16.0-RC1 +date: 2015-10-23 +tags: [nextflow] +--- + + diff --git a/changelog/nextflow/v0.16.0.mdx b/changelog/nextflow/v0.16.0.mdx new file mode 100644 index 000000000..6bda55a6e --- /dev/null +++ b/changelog/nextflow/v0.16.0.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.16.0 +date: 2015-11-04 +tags: [nextflow] +--- + +- Added ability to resubmit task executions changing resource requirements. See #70. +- Added support for private SCM servers and private Gitlab repositories. See #38. +- Added `workflow` metadata and execution `onComplete` notification handler. See #79. +- Added `publishDir` directive. See #81. +- Added extension method `mklink` to create file system links. +- Added Apache Ignite based executor. +- Removed deprecated GridGain executor. +- Updated Capsule to version 1.0.1. diff --git a/changelog/nextflow/v0.16.1.mdx b/changelog/nextflow/v0.16.1.mdx new file mode 100644 index 000000000..c0e2be204 --- /dev/null +++ b/changelog/nextflow/v0.16.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.16.1 +date: 2015-11-07 +tags: [nextflow] +--- + +- Fixed issue #85. Directive `publishDir` can't access process local variables. +- Fixed wrong error message when trying to run a project sticked on a specific revision. +- Fixed `IllegalArgumentException: other must be an instance of com.upplication.s3fs.S3Path` exception when publishing to a S3 path. +- Fixed indentation in repo info command. diff --git a/changelog/nextflow/v0.16.2.mdx b/changelog/nextflow/v0.16.2.mdx new file mode 100644 index 000000000..321e5cbaa --- /dev/null +++ b/changelog/nextflow/v0.16.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.16.2 +date: 2015-11-14 +tags: [nextflow] +--- + +- Fixed #87. Include current configuration profile option in the workflow metadata. +- Fixed #86. Failure if work dir contains one or more blank characters. +- Fixed #76. Include process name and tag information in process wrapper script. diff --git a/changelog/nextflow/v0.16.3.mdx b/changelog/nextflow/v0.16.3.mdx new file mode 100644 index 000000000..3fe47b207 --- /dev/null +++ b/changelog/nextflow/v0.16.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.16.3 +date: 2015-11-30 +tags: [nextflow] +--- + +- Fixed #90. System `user.dir` property is cached causing unexpected behaviour. +- Allow directories in a process input file name declaration. See #91. +- Improved build script for local snapshot deployment. +- Updated cli-args test. diff --git a/changelog/nextflow/v0.16.4.mdx b/changelog/nextflow/v0.16.4.mdx new file mode 100644 index 000000000..5b3a0d1e3 --- /dev/null +++ b/changelog/nextflow/v0.16.4.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.16.4 +date: 2015-12-06 +tags: [nextflow] +--- + +- Use batch strategy to kill pending cluster jobs on termination #93 +- Added support for Git Large File Storage (LFS) extension #82 +- Added configurable thread pool factory #92 diff --git a/changelog/nextflow/v0.16.5.mdx b/changelog/nextflow/v0.16.5.mdx new file mode 100644 index 000000000..215394540 --- /dev/null +++ b/changelog/nextflow/v0.16.5.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.16.5 +date: 2015-12-18 +tags: [nextflow] +--- + +- Fixed race condition when creating cached launcher classpath file +- Fixed `run` for local repositories +- Enhanced output file handling #91 +- Set thread pool size to avail cpus +1 +- Removed config object from remote session that was causing a serialization issue +- Upgraded Slf4j to version 1.7.13 diff --git a/changelog/nextflow/v0.17.0.mdx b/changelog/nextflow/v0.17.0.mdx new file mode 100644 index 000000000..3304423c9 --- /dev/null +++ b/changelog/nextflow/v0.17.0.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.17.0 +date: 2016-01-07 +tags: [nextflow] +--- + +- Fixed PBS/Torque executor does not parse correctly job IDs #96 +- Fixed issue when `TraceFileObsever` tries to access task context metadata on task completion #98 +- Fixed support for Git local bare repositories #95 +- Fixed single quotes in file names result in a script error #99 +- Added `workflow.sessionId` and `workflow.resume` attributes #94 +- Added output into multiple channels #97 +- Added `attempt` field to execution trace file +- Do not allow output clause to reference files outside the process working directory (see #91) diff --git a/changelog/nextflow/v0.17.1.mdx b/changelog/nextflow/v0.17.1.mdx new file mode 100644 index 000000000..78858a9bc --- /dev/null +++ b/changelog/nextflow/v0.17.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.17.1 +date: 2016-01-21 +tags: [nextflow] +--- + +- Fixed splitText performance issue #102 +- Fixed execution hang when a process script block report and error and retry error strategy is set +- Added support for partition to SLURM executor #101 +- Use a dedicated reentrant lock to handle task completion event diff --git a/changelog/nextflow/v0.17.2.mdx b/changelog/nextflow/v0.17.2.mdx new file mode 100644 index 000000000..4a1f5b35e --- /dev/null +++ b/changelog/nextflow/v0.17.2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.17.2 +date: 2016-02-02 +tags: [nextflow] +--- + +- Fixed Channel.subscribe is invoked after the Workflow.onComplete handler #105 +- Changed default trace file name to `trace.txt` #106 +- Changed launcher classpath cache file under user home +- Added JobStealingFailoverSpi to Ignite executor +- Update JGit to version 4.2.0 diff --git a/changelog/nextflow/v0.17.3.mdx b/changelog/nextflow/v0.17.3.mdx new file mode 100644 index 000000000..9d5b97214 --- /dev/null +++ b/changelog/nextflow/v0.17.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.17.3 +date: 2016-02-18 +tags: [nextflow] +--- + +- Fixed task status in the trace file when execution is retried #107 +- Improved Ignite scheduling and node resources allocation +- Upgraded Logback to version 1.1.5 +- Upgrade Slf4j to version 1.7.16 diff --git a/changelog/nextflow/v0.18.0.mdx b/changelog/nextflow/v0.18.0.mdx new file mode 100644 index 000000000..db0afebd1 --- /dev/null +++ b/changelog/nextflow/v0.18.0.mdx @@ -0,0 +1,29 @@ +--- +title: Nextflow v0.18.0 +date: 2016-04-11 +tags: [nextflow] +--- + +- Added `legacy` option to docker configuration properties. + Added support for `--cpuset-cpus` Docker command line option. See #115 +- Added `region` option to AWS S3 config properties #116 +- Added support for AWS S3 multipart uploads #112 +- Added `NXF_TRACE` to enable application trace logging +- Added experimental support for Shifter containers +- Added experimental support for HTCondor scheduler +- Fixed Input file names staged into a subdirectory are not expanded properly #111 +- Fixed Main script class name collides with variable names in global scope #113 +- Fixed config file having a name as a top level config options raise a MissingPropertyException #117 +- Fixed Process script errors should not be ignored #119 +- Fixed timeline margin for long labels - fix #120 +- Fixed Process `start` time is not reported correctly when using the Ignite executor #122 +- Fixed Allow for a per-job memory limit for LSF executor #123 +- Fixed Memory reservation should not be divided by the number of cpus #124 +- Fixed Mixed content errors if timeline.html served over HTTPS #127 +- Fixed Nextflow won't start if a proxy URL env variable contains a trailing slash #109 +- Set poolSize as the number of avail cpus +- Set `java.io.tmpdir` to the same path as `NXF_TEMP` +- Updated Apache Ignite to version 1.5.0 +- Updated Logback to version 1.1.6 +- Updated Slf4j to version 1.7.21 +- Updated JGit to version 4.3.0.201604071810-r diff --git a/changelog/nextflow/v0.18.1.mdx b/changelog/nextflow/v0.18.1.mdx new file mode 100644 index 000000000..369c74b46 --- /dev/null +++ b/changelog/nextflow/v0.18.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.18.1 +date: 2016-04-26 +tags: [nextflow] +--- + +- Fixed Input files containing a parenthesis in the path are not staged properly #133. +- Fixed Process execution hangs when using Ignite executor with a foreign work path #136. +- Fixed Sort output files in lexicographical order #137. +- Added `false` as `sort` option in the `collectFile` operator. diff --git a/changelog/nextflow/v0.18.2.mdx b/changelog/nextflow/v0.18.2.mdx new file mode 100644 index 000000000..86fbe6857 --- /dev/null +++ b/changelog/nextflow/v0.18.2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.18.2 +date: 2016-05-03 +tags: [nextflow] +--- + +- Fixed Variable `task.exitStatus` throws an exception when comparing it to an integer value #142 +- Fixed PublishDir does not handle hard linking of directories #126 +- Added `index` implicit variable to the `task` execution context #139 +- Improved installer messages +- Updated Gradle runtime to version 2.13 diff --git a/changelog/nextflow/v0.18.3.mdx b/changelog/nextflow/v0.18.3.mdx new file mode 100644 index 000000000..929e6cf0c --- /dev/null +++ b/changelog/nextflow/v0.18.3.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.18.3 +date: 2016-05-09 +tags: [nextflow] +--- + +- Fixed Timeline report no longer works in Safari #143 +- Fixed Invalid or corrupt JAR file if your CTRL-C initial run of nextflow #145 +- Fixed Pipeline execution hangs when the into declaration is not provided #146 diff --git a/changelog/nextflow/v0.19.0.mdx b/changelog/nextflow/v0.19.0.mdx new file mode 100644 index 000000000..2681308eb --- /dev/null +++ b/changelog/nextflow/v0.19.0.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.19.0 +date: 2016-05-18 +tags: [nextflow] +--- + +- Added Pipeline execution DAG #147 +- Added support for OpenLava batch scheduler #152 +- Added `-revision` option to `pull` command #110 +- Set `UTF-8` as default file encoding #149 +- Fixed Extend support for empty curly glob pattern #154 +- Fixed Add process directives validation #153 +- Fixed Calculation of freePhysicalMemorySize does not currently take disk cache into account #150 +- Fixed Improve error message when pulling a non-existing branch could be more explicit #156 +- Updated JGit to version 4.3.1 diff --git a/changelog/nextflow/v0.19.1.mdx b/changelog/nextflow/v0.19.1.mdx new file mode 100644 index 000000000..0ab830c6a --- /dev/null +++ b/changelog/nextflow/v0.19.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.19.1 +date: 2016-05-19 +tags: [nextflow] +--- + +- Fixed Spread operator is using deprecated `just` operator #159 +- Fixed Invalid call to `notifyError` method +- Fixed Invalid URL in citoscape.js DAG template +- Improved documentation diff --git a/changelog/nextflow/v0.19.2.mdx b/changelog/nextflow/v0.19.2.mdx new file mode 100644 index 000000000..b25d2a5d3 --- /dev/null +++ b/changelog/nextflow/v0.19.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.19.2 +date: 2016-05-26 +tags: [nextflow] +--- + +- Fixed Module load problem #161 +- Fixed PublishDir does not overwrite symlinks #163 +- Fixed Implement resource accounting for local executor #162 +- Fixed PublishDir fail to move the output directory when the target is a S3 path #160 diff --git a/changelog/nextflow/v0.19.3.mdx b/changelog/nextflow/v0.19.3.mdx new file mode 100644 index 000000000..c6cd998d4 --- /dev/null +++ b/changelog/nextflow/v0.19.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.19.3 +date: 2016-05-31 +tags: [nextflow] +--- + +- Fixed Local executor does not run an job when host cpus == 1 #166 diff --git a/changelog/nextflow/v0.19.4.mdx b/changelog/nextflow/v0.19.4.mdx new file mode 100644 index 000000000..14e827f93 --- /dev/null +++ b/changelog/nextflow/v0.19.4.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.19.4 +date: 2016-06-03 +tags: [nextflow] +--- + +- Fixed Exception is thrown while reporting an invalid output declaration #170 diff --git a/changelog/nextflow/v0.20.0.mdx b/changelog/nextflow/v0.20.0.mdx new file mode 100644 index 000000000..9fe6fda1a --- /dev/null +++ b/changelog/nextflow/v0.20.0.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.20.0 +date: 2016-06-10 +tags: [nextflow] +--- + +- Added `fromFilePairs` channel factory method +- Added `finish` error strategy #158 +- Added ability to change the name and the save path of published files #178 +- Added a syntax validation check for process blocks keywords #177 +- Fixed It's not possible to specify environment modules w/o a version number #174 +- Fixed Local process kill signal is not propagated to children processes #172 +- Fixed scratchDir is overwritten by TMPDIR #171 +- Removed deprecated `Channel.path` methods +- Ignore missing COUT and CERR variables diff --git a/changelog/nextflow/v0.20.1.mdx b/changelog/nextflow/v0.20.1.mdx new file mode 100644 index 000000000..03ae074c6 --- /dev/null +++ b/changelog/nextflow/v0.20.1.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.20.1 +date: 2016-06-18 +tags: [nextflow] +--- + +- Fixed Directives do not accept a negative numeric value #180 +- Fixed Dynamic errorStrategy is not evaluated correctly #183 +- Fixed Pipeline hangs when error strategy is used and an upstream process fail +- Added environment to ContainerBuilder and implement environment export for Shifter containers +- Updated Groovy runtime to version 2.4.7 diff --git a/changelog/nextflow/v0.21.0.mdx b/changelog/nextflow/v0.21.0.mdx new file mode 100644 index 000000000..d3910f550 --- /dev/null +++ b/changelog/nextflow/v0.21.0.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v0.21.0 +date: 2016-07-20 +tags: [nextflow] +--- + +- Fixed Command line params do not override params defined in the nextflow.config file #202 + +(included in 0.21.0-RC1) +- Fixed Ability to customize job name submitted to the scheduler #140 +- Fixed Duplicate output error when no channel specified #182 +- Fixed File paths containing a timestamp are parsed as a Duration object #185 +- Fixed ClosedByInterruptException is thrown randomly #188 +- Fixed Pipeline hangs when `Channel.from` argument is an empty list #189 +- Fixed Handle customised sbatch returning the jobid by itself #190 +- Fixed LocalExecutor can randomly hang with no running task #191 +- Fixed Missing flag in SLURM `squeue` call #193 +- Fixed Process script declaring a regexp expression results in a IllegalAccessException #199 +- Merged Silence mkdir error if NXF_HOME not writable #187 +- Refactored ParallelTaskProcessor and TaskProcessor classes to a single class +- Added `ST` and `BF` queue statuses to SLURM executor +- Improved logging information +- Upgrade to Gradle 2.14 diff --git a/changelog/nextflow/v0.21.1.mdx b/changelog/nextflow/v0.21.1.mdx new file mode 100644 index 000000000..7055f548e --- /dev/null +++ b/changelog/nextflow/v0.21.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.21.1 +date: 2016-07-29 +tags: [nextflow] +--- + +- Fixed NFS work dir is not detected correctly #206 +- Fixed `splitFasta` operator with the file parameter will not split into single fasta files #181 +- Enable log file for commands when debug or trace option is specified +- Added validation checks to `fromPath` and `fromFilePairs` methods diff --git a/changelog/nextflow/v0.21.2.mdx b/changelog/nextflow/v0.21.2.mdx new file mode 100644 index 000000000..b9b4e83bf --- /dev/null +++ b/changelog/nextflow/v0.21.2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.21.2 +date: 2016-08-12 +tags: [nextflow] +--- + +- Fixed PBS professional batch scheduler submission error #209 +- Fixed Reference to a collection of files is not resolved properly in the output section #214 +- Improved failed and ignored processes reporting +- Fixed null workflow.projectDir when launching a script file +- Do no output link file when `followLinks` option is disabled diff --git a/changelog/nextflow/v0.21.3.mdx b/changelog/nextflow/v0.21.3.mdx new file mode 100644 index 000000000..85d8b6359 --- /dev/null +++ b/changelog/nextflow/v0.21.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.21.3 +date: 2016-08-26 +tags: [nextflow] +--- + +- Fixed Spaces in work directory path stops SLURM from accepting the job #218 diff --git a/changelog/nextflow/v0.22.0.mdx b/changelog/nextflow/v0.22.0.mdx new file mode 100644 index 000000000..515be1a42 --- /dev/null +++ b/changelog/nextflow/v0.22.0.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v0.22.0 +date: 2016-09-21 +tags: [nextflow] +--- + +- Fixed queue-size attribute for local executor +- Fixed Kubernetes pod id parse issue +- Moved `.nextflow.history` and `.cache` files under `.nextflow` directory + +[0.22.0.RC2] +- Fixed File name containing glob wildcards cannot be captured in the process output #219 +- Fixed Work dir containing glob wildcards are not supported #194 +- Added `revision id` to execution log +- Added `scriptId`, `scriptFile` and `scriptName` attributes to workflow metadata object +- Added time delay penalty on error burst to prevent failing node to drain all pending jobs +- Load classes without creating an instance of each cloud driver +- Improved AWS driver missing credentials error report +- Merged experimental Kubernetes support +- Improved clean and log command +- Added EFS default mount path +- Refactored daemon shutdown + +[0.22.0.RC1] +- Fixed Implement clean up command #19 +- Fixed Trace file should include cached tasks #114 +- Added ability to log each command run #108 +- Added new `cloud` command +- Added AWS EFS support +- Added AWS Spot instance error fail-over +- Added support cloud auto scaling +- Added Ignite job-stealing distributed scheduler diff --git a/changelog/nextflow/v0.22.1.mdx b/changelog/nextflow/v0.22.1.mdx new file mode 100644 index 000000000..2246e6227 --- /dev/null +++ b/changelog/nextflow/v0.22.1.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.22.1 +date: 2016-09-26 +tags: [nextflow] +--- + +- Fixed Nested symlinks are not resolved by Docker container mounts #222 +- Fixed Nextflow execution log fail to get field starting with '%' #223 +- Fixed Nextflow console launcher +- Added `ContainerCreation` status to K8S executor +- Expand `=` to `==` in filter expressions to avoid misleading results diff --git a/changelog/nextflow/v0.22.2.mdx b/changelog/nextflow/v0.22.2.mdx new file mode 100644 index 000000000..f4778eff9 --- /dev/null +++ b/changelog/nextflow/v0.22.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.22.2 +date: 2016-10-03 +tags: [nextflow] +--- + +- Fixed Copy input files to scratch directory #197 +- Fixed PBS qsub fails when the job name starts with a dot #228 +- Fixed issue when staging-out a symlink output file +- Fixed log warning when running a script in the console diff --git a/changelog/nextflow/v0.22.3.mdx b/changelog/nextflow/v0.22.3.mdx new file mode 100644 index 000000000..338238330 --- /dev/null +++ b/changelog/nextflow/v0.22.3.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.22.3 +date: 2016-10-12 +tags: [nextflow] +--- + +- Fixed PBS qsub fails when the job name is longer than 15 chars #228 +- Fixed Spread operator doesn't connect channels in DAG #231 +- Fixed amazon prices file format parser +- Added Cleanup scratch dir upon process completion #230 +- Added `optional` flag to output file declaration +- Added `region` option to `cloud` command +- Added Check for missing instance type description diff --git a/changelog/nextflow/v0.22.4.mdx b/changelog/nextflow/v0.22.4.mdx new file mode 100644 index 000000000..4e6364567 --- /dev/null +++ b/changelog/nextflow/v0.22.4.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.22.4 +date: 2016-11-04 +tags: [nextflow] +--- + +- Added `--no-requeue` flag to SLURM job submission +- Report log content when a wrapper script execution fail #213 +- Improved error message when cache DB cannot be created +- Logging error track trace on task re-submit failure +- Fixed Channel.fromPath throws an exception when the argument is a S3 path +- Modified `make_temp` so that uses `NXF_TEMP` when defined diff --git a/changelog/nextflow/v0.22.5.mdx b/changelog/nextflow/v0.22.5.mdx new file mode 100644 index 000000000..29b0acb41 --- /dev/null +++ b/changelog/nextflow/v0.22.5.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.22.5 +date: 2016-11-17 +tags: [nextflow] +--- + +- Fixed QueueSize=1 doesn't handle multi-cpu processes #246 +- Fixed Accessing to a not defined script params should raise an error #243 +- Fixed An input channel evaluating to null results in a misleading error message #242 +- Fixed Use of publicDnsName should failover to IP if no name is available #240 +- Fixed Use of yum in cloud boothook may cause problems #239 +- Fixed Execution hang when an operator invokes the `exit` function and no processes have run +- Fixed fromFilePairs does not match patterns containing curly brackets w/o a star wild character +- Added `-dump-hashes` command line option to print task key hash keys #211 +- Improved logging diff --git a/changelog/nextflow/v0.22.6.mdx b/changelog/nextflow/v0.22.6.mdx new file mode 100644 index 000000000..8e5dbb0dd --- /dev/null +++ b/changelog/nextflow/v0.22.6.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.22.6 +date: 2016-12-04 +tags: [nextflow] +--- + +- Fixed Script execution terminates before all operators complete #259 +- Fixed A script variable with the same name of a global variable invalidate process resume #254 +- Fixed `when` is not recognised when used before an `input` and `script` is not declared +- Fixed count operator hung when applied to a dataflow variable +- Added warning message when an input/output `set` defines only one component #216 #251 +- Reduced log verbosity of Ignite Scheduler classes diff --git a/changelog/nextflow/v0.23.0.mdx b/changelog/nextflow/v0.23.0.mdx new file mode 100644 index 000000000..401b97d25 --- /dev/null +++ b/changelog/nextflow/v0.23.0.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.23.0 +date: 2016-12-13 +tags: [nextflow] +--- + +- Added support for Singularity containers #252 +- Added support for HTTP/S and FTP files (read-only) +- Fixed stream close leak while copy foreign file to local file system +- Fixed Task scheduling may hang while checking for job completion #261 +- Fixed Specifying the keyFile cloud config attribute result in an error #263 +- Added support for multiple target channels in `tap` operator #255 +- Added `uri` property to Path and File objects +- Made NXF_SCRATCH variable accessible to `beforeScript` handler diff --git a/changelog/nextflow/v0.23.1.mdx b/changelog/nextflow/v0.23.1.mdx new file mode 100644 index 000000000..c01322ce9 --- /dev/null +++ b/changelog/nextflow/v0.23.1.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.23.1 +date: 2017-01-23 +tags: [nextflow] +--- + +- Fixed FixOwnership flag break non BASH scripts/templates #270 +- Fixed Fixed PBS Executor should not have parenthesis #271 +- Fixed Function nxf_kill is not invoked properly on process termination #275 +- Fixed Timeline.html is not working on IE11 #272 +- Fixed Merge process specific extended properties with the ones defined in the default scope #273 +- Fixed Using storeDir and publishDir in the same process yields unexpected results #266 diff --git a/changelog/nextflow/v0.23.2.mdx b/changelog/nextflow/v0.23.2.mdx new file mode 100644 index 000000000..d0cf242b7 --- /dev/null +++ b/changelog/nextflow/v0.23.2.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.23.2 +date: 2017-02-02 +tags: [nextflow] +--- + +- Improved history lock error message +- Fixed typo in warning message +- Added `cleanup` to list of accepted directives +- Added NXF_OWNER to kubernetes executor +- Fixed Function `nxf_kill` is not invoked properly on a containerised process #275 +- Fixed Pending grid jobs are not cancelled upon pipeline interruption +- Documented that the toSortedList operator can accept a comparator closure #277 diff --git a/changelog/nextflow/v0.23.3.mdx b/changelog/nextflow/v0.23.3.mdx new file mode 100644 index 000000000..4cc55c37a --- /dev/null +++ b/changelog/nextflow/v0.23.3.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.23.3 +date: 2017-02-09 +tags: [nextflow] +--- + +- Fixed Job termination is not recognised if the starter file is not created #268 +- Fixed Allow NF console to resume process executions (second take) #280 +- Fixed PublishDir may throw a FileAlredyExistsException #283 +- Increased logger file appender buffer size to 64kb +- Updated Logback to version 1.1.10 +- Updated copyright info +- Fixed NXF_DEBUG level diff --git a/changelog/nextflow/v0.23.4.mdx b/changelog/nextflow/v0.23.4.mdx new file mode 100644 index 000000000..80caba809 --- /dev/null +++ b/changelog/nextflow/v0.23.4.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.23.4 +date: 2017-02-24 +tags: [nextflow] +--- + +- Fixed Show a warning message when accessing undefined parameters #293 +- Fixed Staging input files in a subfolder changes their names when they are symlinks #292 +- Fixed NPE accessing foreign files +- Added column char to list of path escaped chars +- Fixed Boothook script fails on Ubuntu 16.04 diff --git a/changelog/nextflow/v0.24.0.mdx b/changelog/nextflow/v0.24.0.mdx new file mode 100644 index 000000000..ef9330c74 --- /dev/null +++ b/changelog/nextflow/v0.24.0.mdx @@ -0,0 +1,17 @@ +--- +title: Nextflow v0.24.0 +date: 2017-03-20 +tags: [nextflow] +--- + +- Added new `combine` operator #298 +- Added new `collect` operator #297 +- Added new CLI option `-params-file` to load parameters from a json/yaml file #208 +- Fixed SCM user name is not set accessing private repository #300 +- Fixed Infer singleton process outputs from inputs declaration #301 +- Fixed Use exist status 1 for all NF errors #304 +- Fixed Invalid SGE job name as defined in `sge_types` #299 +- Added `skip` parameter to collectFile operator #306 +- Added experimental `fs` command +- Improved file staging error reports #295 +- Upgraded Groovy to version 2.4.10 diff --git a/changelog/nextflow/v0.24.1.mdx b/changelog/nextflow/v0.24.1.mdx new file mode 100644 index 000000000..d2535868e --- /dev/null +++ b/changelog/nextflow/v0.24.1.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.24.1 +date: 2017-03-24 +tags: [nextflow] +--- + +- Fixed Improve explanation of cache DB IOException #303 +- Fixed Operator ifEmpty results in a error when applied to a dataflow variable #308 +- Fixed Process execution fails when the work path contains a parenthesis character #310 +- Fixed Installer script fails when current path contains a blank character #311 +- Fixed Include SLURM partition when checking job status #312 +- Allow the usage of `close` operator on unbounded dataflow variable diff --git a/changelog/nextflow/v0.24.2.mdx b/changelog/nextflow/v0.24.2.mdx new file mode 100644 index 000000000..7a8aad406 --- /dev/null +++ b/changelog/nextflow/v0.24.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.24.2 +date: 2017-04-05 +tags: [nextflow] +--- + +- Fixed Tuple array object deserialisation fails #317 +- Fixed Execution time is incorrect for the local executor #313 +- Use SLURM squeue `--noheader` instead -h command line option to support not standard implementation #316 diff --git a/changelog/nextflow/v0.24.3.mdx b/changelog/nextflow/v0.24.3.mdx new file mode 100644 index 000000000..697df18ed --- /dev/null +++ b/changelog/nextflow/v0.24.3.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.24.3 +date: 2017-04-24 +tags: [nextflow] +--- + +- Fixed Process execution fails with not GNU version of sleep and date tools #321 +- Fixed Pending processes are not cleaned up properly #322 +- Fixed NPE is thrown when Singularity is enabled and a process uses no container #324 +- Fixed Cached processes are not included in the timeline report #325 +- Added MD5 digest file upload +- Updated docs diff --git a/changelog/nextflow/v0.24.4.mdx b/changelog/nextflow/v0.24.4.mdx new file mode 100644 index 000000000..5cbe7f0bf --- /dev/null +++ b/changelog/nextflow/v0.24.4.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.24.4 +date: 2017-05-22 +tags: [nextflow] +--- + +- Fixed PublishDir creates nested directory structures when a folder already exists #342 +- Fixed NoSuchFileException is thrown when trace file path does not exist #334 +- Fixed watchPath glob directory not working #335 +- Fixed Channel.fromFilePairs does not handle properly multiple star wildcards #337 +- Added executor for NQSII, queuing system used on NEC clusters. +- Added `relative` option to `fromPath` channel factory diff --git a/changelog/nextflow/v0.25.0.mdx b/changelog/nextflow/v0.25.0.mdx new file mode 100644 index 000000000..958533e31 --- /dev/null +++ b/changelog/nextflow/v0.25.0.mdx @@ -0,0 +1,46 @@ +--- +title: Nextflow v0.25.0 +date: 2017-06-26 +tags: [nextflow] +--- + +### Improvements and fixed issue + +- Fixed Dataflow threads pool get exhausted with a large number of tasks #92 +- Fixed Custom function cannot be invoked in the workflow completion handler #374 +- Fixed Runtime errors are not reported in the `workflow.errorMessage` property #369 +- Fixed Warn if params.something is defined twice in a NF script #372 +- Fixed `Map.Entry` values deserialisation process fail #373 +- Fixed List active operators that may hang the script execution #315 +- Fixed launcher error message #366 +- Fixed AWS spot instance `bootStorageSize` property is ignored #368 +- Fixed Implicit variable `task` is not accessible in cached processes #363 +- Fixed Do not export user environment when submitting job to SGE-like batch scheduler #362 +- Fixed Process termination can throw a `ConcurrentModificationException` hiding the error cause message #359 +- Fixed `GroovyRuntimeException` during foreign file copy process #360 +- Fixed Helper function to compare version numbers #319 +- Fixed Docker input file mounts should be read-only for enforce container security #346 +- Fixed Extend `each` repeater syntax to support file collections #355 +- Fixed Modified task properties are not accessible in the command script during task retry #345 +- Fixed PublishDir warning message +- Fixed Spread operator mishandles Iterable values provided as a dataflow variable #353 +- Fixed UUID cli options are wrongly interpreted as `Duration` objects #349 +- New `toInteger` converter operator +- New `randomSample` operator #344 +- New `simpleName` extension method to Path/File objects #354 +- New warning message when input tuple cardinality does not match declared length #348 +- Improved use example into ext directive documentation #327 +- Improved error handing when parsing trace file #371 +- Improved error reporting for process missing input definition +- Improved launcher script to support https protocol by default #379 +- Change `maxErrors` default to -1 +- Deprecated identifier `channel` as variable name + + +### Special note + +* Directive `maxErrors` new default is `-1`, this means that by default this value is ignored when a task execution is retried and only maxRetries value the is taken in consideration. +* Docker input mounts are now enforced as read-only. This has been done to mitigate possible security concerns when using Docker containers. It must noted that this is coherent with the idempotent nature of nextflow processes by which a task cannot have side-effects (and therefore modify the input files). +* SGE, PBS/Torque and NGSII executors do not specify any more the `-V` flag when submitting a job request. If you need to export the user environment in your task you will need to add it by using the `clusterOptions` directive. + + diff --git a/changelog/nextflow/v0.25.1.mdx b/changelog/nextflow/v0.25.1.mdx new file mode 100644 index 000000000..0802e643e --- /dev/null +++ b/changelog/nextflow/v0.25.1.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.25.1 +date: 2017-06-27 +tags: [nextflow] +--- + +### Fixed issue + +- Duplicate mount point docker error #384. + +### Note + +- Docker read-only mounts feature (#346) is still considered experimental, therefore mounts are writeable by default. To mount input paths as read-only set `docker.writableInputMounts=false` in the nextflow config file. diff --git a/changelog/nextflow/v0.25.2.mdx b/changelog/nextflow/v0.25.2.mdx new file mode 100644 index 000000000..5951df4bd --- /dev/null +++ b/changelog/nextflow/v0.25.2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.25.2 +date: 2017-07-03 +tags: [nextflow] +--- + +- Fixed Execution hangs if a job submission fail #396 +- Fixed stdout can not be sent into multiple channels #388 +- Fixed Pipeline execution hangs when a process exceed the time limit and retry error strategy is used #387 +- Added scientists and adjectives to run name generator +- Deprecated `route` operator diff --git a/changelog/nextflow/v0.25.3.mdx b/changelog/nextflow/v0.25.3.mdx new file mode 100644 index 000000000..c9dbcf3e4 --- /dev/null +++ b/changelog/nextflow/v0.25.3.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v0.25.3 +date: 2017-07-31 +tags: [nextflow] +--- + +- Fixed NPE when parsing AWS price file #408 +- Fixed Grid queue status return wrong data when a process change the submission queue dynamically #412 +- Fixed MPI-like execution for SLURM batch scheduler - 13f3a091d7dc24c5712216c34b58d7ce8a947d0a +- Fixed NPE when log params key is not defined +- Fixed Optional parameter for set #399 +- Added automatic pull for Singularity remote images #356 +- Added London and Canada AWS regions +- Merged Pass NXF_OPTS to JVM during the java version check to allow memory definition on memory-restricted environments #411 +- Improved error message in launcher file - 4f05666e8c26d5ec3255bf6d6a7448ac235b2689 diff --git a/changelog/nextflow/v0.25.4.mdx b/changelog/nextflow/v0.25.4.mdx new file mode 100644 index 000000000..36a426501 --- /dev/null +++ b/changelog/nextflow/v0.25.4.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.25.4 +date: 2017-07-31 +tags: [nextflow] +--- + +- Removed invalid debug information diff --git a/changelog/nextflow/v0.25.5.mdx b/changelog/nextflow/v0.25.5.mdx new file mode 100644 index 000000000..41855352a --- /dev/null +++ b/changelog/nextflow/v0.25.5.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.25.5 +date: 2017-08-04 +tags: [nextflow] +--- + +- Fixed NF fails to pull images hosted in the Singularity Hub #414 +- Added `-y` to cloud create command to skip confirmation request diff --git a/changelog/nextflow/v0.25.6.mdx b/changelog/nextflow/v0.25.6.mdx new file mode 100644 index 000000000..a93681699 --- /dev/null +++ b/changelog/nextflow/v0.25.6.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.25.6 +date: 2017-08-13 +tags: [nextflow] +--- + +- Fixed Empty channel waiting forever when viewed and mixed #428 +- Fixed Error Channels cannot be used as input in more than one process or operator #429 +- Fixed Script body is resolved even if the `when` guard evaluate to false +- Added queue process directive as option for trace file #431 diff --git a/changelog/nextflow/v0.25.7.mdx b/changelog/nextflow/v0.25.7.mdx new file mode 100644 index 000000000..7fdfb1cd8 --- /dev/null +++ b/changelog/nextflow/v0.25.7.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.25.7 +date: 2017-09-06 +tags: [nextflow] +--- + +- Fixed Unable to parse the AWS price list API #444 +- Added seed parameter to `randomSample` operator #410 diff --git a/changelog/nextflow/v0.26.0.mdx b/changelog/nextflow/v0.26.0.mdx new file mode 100644 index 000000000..d54ba42df --- /dev/null +++ b/changelog/nextflow/v0.26.0.mdx @@ -0,0 +1,54 @@ +--- +title: Nextflow v0.26.0 +date: 2017-11-08 +tags: [nextflow] +--- + +- Fixed file method does not interpret correctly S3 path with globs #509 +- Fixed Execution hangs when the amount of requested resources exceed the available ones #502 +- Minor change in the execution report #507 #508 +- Make AWS clustering compliant with billing by seconds +- Refactored `nf-token` AWS job definition parameter #475 +- Run Batch task in a scratch directory to avoid undefined execution folder #475 +- Renamed `iamProfile` to `instanceRole` #422 +- Renamed ProcessNotRecoverableException to ProcessUnrecoverableException + +From 0.26.0-RC2 +- Fixed TMP and TMPDIR variables are not passed in Singularity environment #496 +- Fixed Dynamic resources directive when defined both in a process and the config file cause an error #497 +- Added Experimental support for Shifter containers #500 #501 +- Improved AWS Batch task logging and task attempts +- Improved Execution report showing task realtime instead of task duration on time box plot + +From 0.26.0-RC1 +- Added support for AWS Batch #475 +- Added support for AWS IAM role #422 +- Added Experimental support for Java 9 #462 +- Added transpose operator #440 +- Added join operator #460 +- Added html report (-with-report option) +- Added Gzip compression support to splitXxx operators #484 +- Added Support PE Fastq files splitting #436 +- Added Operator splitFasta should allow the creation of chunk having the same size #472 +- Added HTML execution report #490 #491 +- Added New scientist names #485 +- Improved merge operator #458 +- Improved value channel handling for reduce, filter, first, take and randomSample operators +- Prints a warning message when the config file defines setting not matching any process definition +- Fixed HEAD is detached error #389 +- Fixed Include container name when calculating cache key #443 +- Fixed Invalidate process cache when a referenced external script is modified #413 +- Fixed Execution failure is not reported in the trace file when retry error strategy is used #404 +- Fixed "when" directive should not allow staging of input files for a process, if the criteria are not met #424 +- Fixed Failure during foreign files download cause execution to stop abruptly #295 +- Fixed The parameter groupName cannot be used with the parameter subnet #465 +- Fixed unable to download from gitlab.com public repository #457 +- Fixed Print work directory when a task fails #445 +- Fixed Misleading command line parameter type conversion #434 +- Fixed Nextflow should not stage files that have the same name #470 +- Fixed SplitCsv returns array objects instead of Lists #487 +- Fixed Cannot cast object FtpURLConnection error #482 +- Fixed Nested Environment Module names are not loaded properly #489 +- Removed support support for Java 7 #385 +- Removed deprecated Cirrus/ClusterK executor +- Removed deprecated support for DNAnexus #386 diff --git a/changelog/nextflow/v0.26.1.mdx b/changelog/nextflow/v0.26.1.mdx new file mode 100644 index 000000000..0d7141e5e --- /dev/null +++ b/changelog/nextflow/v0.26.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.26.1 +date: 2017-11-17 +tags: [nextflow] +--- + +- Execution report enhancements #521 +- Fixed Add AWS_DEFAULT_REGION environment variable to bash wrapper scripts #512 #513 +- Fixed New launcher script does not allow the execution of legacy version with Java 7 #519 +- Fixed Error message reporting file name collision is misleading #516 diff --git a/changelog/nextflow/v0.26.2.mdx b/changelog/nextflow/v0.26.2.mdx new file mode 100644 index 000000000..943339aa0 --- /dev/null +++ b/changelog/nextflow/v0.26.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.26.2 +date: 2017-11-27 +tags: [nextflow] +--- + +- Fixed readlink illegal option when installing in macOS #527 +- Fixed Getting not descriptive error when using a when condition and script statement is not explicit #528 +- Fixed Function nxf_module_load matches partial names #530 diff --git a/changelog/nextflow/v0.26.3.mdx b/changelog/nextflow/v0.26.3.mdx new file mode 100644 index 000000000..48c851106 --- /dev/null +++ b/changelog/nextflow/v0.26.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.26.3 +date: 2017-11-30 +tags: [nextflow] +--- + +- Fixed AWS Batch S3 upload function does not work if output is a directory #539 +- Fixed AWS Batch S3 uploaded function does not resolve glob patterns containing curly brackets #535 +- Added author field in the config manifest scope #537 +- Upgrading s3fs library to 1.0.2 version supporting `signerOverride` S3 config property. diff --git a/changelog/nextflow/v0.26.4.mdx b/changelog/nextflow/v0.26.4.mdx new file mode 100644 index 000000000..17a0a0861 --- /dev/null +++ b/changelog/nextflow/v0.26.4.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.26.4 +date: 2017-12-11 +tags: [nextflow] +--- + +Fixed GitLab auth token is not applied when user credentials are not provided #542 diff --git a/changelog/nextflow/v0.27.0.mdx b/changelog/nextflow/v0.27.0.mdx new file mode 100644 index 000000000..9950e2d13 --- /dev/null +++ b/changelog/nextflow/v0.27.0.mdx @@ -0,0 +1,44 @@ +--- +title: Nextflow v0.27.0 +date: 2018-01-09 +tags: [nextflow] +--- + +- Fixed Log command prints true instead of actual message #561 +- Fixed `NXF_TEMP` definition when `instanceStorageMount` is set +- Improved S3 exitfile logging +- Improved cloud config canonical formatting + +(from 0.27.0-RC1/2 release) +- Fixed Ignore Windows instances from AWS cloud price listing +- Fixed AWS price reader catching unexpected errors +- Fixed `sendMail` access to owner variables +- Fixed NPE when creating task with ignite executor +- Fixed `null` exit status in notification template #554 +- Added `XPath` serialiser +- Added mail smtp proxy configuration #375 +- Added built-in notification documentation #554 +- Added built-in mail documentation #375 +- Added support for Syslog logging #330 #557 +- Improved support for AWS EC2 instance storage #558 +- Improved documentation #558 +- Improved config command adding `-flat` and `-properties` formats and using canonical curly brackets format as default +- Update copyright info +- AWS Batch increased queue to 1000 tasks and poll interval to 10 secs +- AWS Batch improved executor scalability caching recurrent API call and batching similar requests together +- Added notification message on workflow completion #554 +- Added built-in `sendMail` function #375 +- Added Warning message when a local version on a GH repo is different from remote #376 +- Added `keepHeader` option to `collectFile` #479 +- Added `dump` operator to enable easier debugging #517 +- Fixed Report an error message when a config file contains an unresolved attribute #525 +- Fixed Session working file system not defined when staging input files with Ignite executor #555 +- Fixed `storeDir` writes output files even when process fails #227 +- Fixed `storeDir` does not work with S3 targets #247 +- Fixed Config file available in introspection #264 +- Fixed Enhance container interoperability between Docker and Singularity #503 +- Fixed Process environment is not exported in the container context when a process uses an interpreter other than BASH #495 +- Deprecated support for executable containers #529 +- Deprecated DRMAA executor #488 +- Deprecated Extrae profiling #543 +- Renamed `.command.run.1` to `.command.stub` #523 diff --git a/changelog/nextflow/v0.27.1.mdx b/changelog/nextflow/v0.27.1.mdx new file mode 100644 index 000000000..ccf2b20d5 --- /dev/null +++ b/changelog/nextflow/v0.27.1.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.27.1 +date: 2018-01-18 +tags: [nextflow] +--- + +- Fixed Invalid cast exception when cpus value is missing #575 +- Fixed Kill the tee commands when the launcher script exit #574 +- Fixed Splitter `limit` option is not honored when splitting more than one file #573 +- Fixed AWS CLI operations with S3 should use the --only-show-errors options #567 +- Fixed Splitter by option is not honored when splitting more than one file #570 +- Documentation editing/improvement diff --git a/changelog/nextflow/v0.27.2.mdx b/changelog/nextflow/v0.27.2.mdx new file mode 100644 index 000000000..13b4f7f71 --- /dev/null +++ b/changelog/nextflow/v0.27.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.27.2 +date: 2018-01-23 +tags: [nextflow] +--- + +- Fixed Config property keys may contain invalid characters +- Fixed Local process kill signal is not propagated to children processes #581 +- Fixed Operator join throws a stack overflow exception when an invalid argument type is specified #582 diff --git a/changelog/nextflow/v0.27.3.mdx b/changelog/nextflow/v0.27.3.mdx new file mode 100644 index 000000000..a4f1a2cb8 --- /dev/null +++ b/changelog/nextflow/v0.27.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.27.3 +date: 2018-01-29 +tags: [nextflow] +--- + +- Fixed publishDir directive fails on S3 when attempting to copy objects larger than 5 GB #585 +- Process name does not reflect dynamic tag declaration when a task execution is retried #586 +- Fixed examples in the documentation +- Update to Gradle 4.5 diff --git a/changelog/nextflow/v0.27.4.mdx b/changelog/nextflow/v0.27.4.mdx new file mode 100644 index 000000000..7d5fac788 --- /dev/null +++ b/changelog/nextflow/v0.27.4.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.27.4 +date: 2018-02-05 +tags: [nextflow] +--- + +- Fixed Resume does not work for tasks successfully executed in a re-submit attempt #591 +- Fixed An error is reported when a NF script contains a class definition #594 +- Fixed Launcher error when download target path contains a blank character diff --git a/changelog/nextflow/v0.27.5.mdx b/changelog/nextflow/v0.27.5.mdx new file mode 100644 index 000000000..72e99ff0d --- /dev/null +++ b/changelog/nextflow/v0.27.5.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.27.5 +date: 2018-02-16 +tags: [nextflow] +--- + +- Fixed dir/* input file pattern invalidate cached processes #610 +- Fixed Mail attachment are not correctly recognised by the email client #609 +- Fixed Workflow metadata container attribute is not resolved when it's defined dynamically #602 diff --git a/changelog/nextflow/v0.27.6.mdx b/changelog/nextflow/v0.27.6.mdx new file mode 100644 index 000000000..a163b85e5 --- /dev/null +++ b/changelog/nextflow/v0.27.6.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.27.6 +date: 2018-02-19 +tags: [nextflow] +--- + +- Fixed Operator toList hangs when applied to a value channel #612 +- Allow launcher to track installation verb diff --git a/changelog/nextflow/v0.28.0.mdx b/changelog/nextflow/v0.28.0.mdx new file mode 100644 index 000000000..110c2c680 --- /dev/null +++ b/changelog/nextflow/v0.28.0.mdx @@ -0,0 +1,37 @@ +--- +title: Nextflow v0.28.0 +date: 2018-03-10 +tags: [nextflow] +--- + +- Fixed Singularity pull is executed even when container execution is disabled #628 +- Fixed issue when setting container attribute to `false` [9de636c5] +- Added MemoryUnit getters [f99d2dc9] +- Added default NXF_TEMP variable [d36ac4dd] +- Added progress stacked bars to workflow report #534 [455fcb4f] +- Added namespace option to `kuberun` command [50154ec5] +- Improved workflow stats and warn report [e795b134] +- Improved K8s error reporting [86f172eb] + +from 0.28.0-RC1 + +- Added support for directory wildcards in input file declarations #568 +- Added ability to access task existStatus value as an output value #577 +- Added ability to use property syntax in the declaration of output values #578 +- Added NXF_JAVA_HOME variable to specify nextflow nextflow JVM #607 +- Added support for docker mount flags #572 +- Added ability to select multiple configuration profiles #370 +- Added ability to copy symlinks to publishDir directive #592 +- Added missing native_id TraceRecord field to K8s and AWS Batch task handlers +- Enhanced support for Kubernetes #468 +- Fixed Launcher breaks when JAVA_HOME path contains a blank char #616 +- Fixed Operator toList hangs when applied to a value channel #612 +- Workflow report should warn if some task executions were ignored #534 +- Enable support for large execution reports #547 +- Replaced the use of named pipes with anonymous pipes #606 +- Enhance the config command show dynamic attributes #604 +- Fixed bin path is not recognised when contains a blank char #603 +- Fixed A NPE exception is thrown when a env variable is assigned to an null value #593 +- Fixed summary stats when for empty series #547 +- Removed support for Extrae #588 +- Removed support for DRMAA #587 diff --git a/changelog/nextflow/v0.28.1.mdx b/changelog/nextflow/v0.28.1.mdx new file mode 100644 index 000000000..3df3fb43f --- /dev/null +++ b/changelog/nextflow/v0.28.1.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.28.1 +date: 2018-03-27 +tags: [nextflow] +--- + +- Fixed A HTTP access error is raised when the URL contains a `?` character #634 +- Fixed Creation of temp files in the `/dev/shm` directory can result in a permission + error in some Linux installations #638 +- Make process echo safer +- Improved documentation diff --git a/changelog/nextflow/v0.28.2.mdx b/changelog/nextflow/v0.28.2.mdx new file mode 100644 index 000000000..7c3990e1d --- /dev/null +++ b/changelog/nextflow/v0.28.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.28.2 +date: 2018-04-06 +tags: [nextflow] +--- + +- Fixed Class FtpURLConnection is not accessible when using Java 9 #646 +- Fixed Lengthen mktemp TEMPLATE so works on BusyBox #647 +- Fixed Report HTML/CSS tweaks to make progress bar text overflow work properly #645 +- Fixed typo in the nextflow launcher #643 diff --git a/changelog/nextflow/v0.29.0.mdx b/changelog/nextflow/v0.29.0.mdx new file mode 100644 index 000000000..2ce3bea2c --- /dev/null +++ b/changelog/nextflow/v0.29.0.mdx @@ -0,0 +1,18 @@ +--- +title: Nextflow v0.29.0 +date: 2018-04-24 +tags: [nextflow] +--- + +0.29.0 - 24 Apr 2018 +- Fixed Buffer operator fails to recognise optional parameter when a closing condition is specified #652 +- Fixed PublishDir mode "copyNoFollow" does not work for directories #658 +- Update NameGenerator adjectives #656 + +(already included in 0.29.0-RC1) +- Added `containerOptions` directive #415 +- Added support for multiple `publishDir` directives for process #256 +- Added cleanup feature to delete workflow work dir on completion #649 +- Added label directive and process configuration selectors `withLabel` and `withName` #623 +- Fixed Invalid process cache when using a different environment module #627 +- Upgrading groovy runtime to version 2.4.15 diff --git a/changelog/nextflow/v0.29.1.mdx b/changelog/nextflow/v0.29.1.mdx new file mode 100644 index 000000000..135b6db40 --- /dev/null +++ b/changelog/nextflow/v0.29.1.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.29.1 +date: 2018-05-10 +tags: [nextflow] +--- + +- Fixed Default `ext` property are not included in process context #673 +- Fixed Operator concat throws a `ConcurrentModificationException` #675 +- Fixed Output file is not recognised when it's created into a subdir and the name matches an input #688 +- Fixed Empty container definition being ignored when default one is specified #691 +- Fixed K8s client fails to connect the cluster when client key nor certificate is specified #692 +- Fixed K8s executor hang on pod creation failure +- Added select in -R for memory for LSF executor #683 diff --git a/changelog/nextflow/v0.3.0.mdx b/changelog/nextflow/v0.3.0.mdx new file mode 100644 index 000000000..d8568842f --- /dev/null +++ b/changelog/nextflow/v0.3.0.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.3.0 +date: 2013-07-11 +tags: [nextflow] +--- + +11 Jul 2013 +- Decoupled the processors logic by the execution strategy implementation +- Normalised script level arguments so that a blank char may be used in place of the equals char +- Added a new configuration option named 'clusterOptions' where specify grid native configuration parameters +- Added a new configuration option named 'scratch' which enable/disable usage of scratch temporary folder when using cluster executors +- Enhanced implementation of LSF executor diff --git a/changelog/nextflow/v0.3.1.mdx b/changelog/nextflow/v0.3.1.mdx new file mode 100644 index 000000000..eabfd8c5f --- /dev/null +++ b/changelog/nextflow/v0.3.1.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.3.1 +date: 2013-07-18 +tags: [nextflow] +--- + +- Added command line parameter 'echo' to enable default tasks output +- Fixed an issue on merge task, when it doesn't collect any data the execution is skipped diff --git a/changelog/nextflow/v0.3.2.mdx b/changelog/nextflow/v0.3.2.mdx new file mode 100644 index 000000000..1f331bcde --- /dev/null +++ b/changelog/nextflow/v0.3.2.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.3.2 +date: 2013-07-22 +tags: [nextflow] +--- + +- New command line option '-log' to specify the application log file +- New command line options '-task.xxx' to task default parameters (overriding the ones in the configuration file) +- Fixed a bug which was preventing the caching mechanism to work properly +- Fixed synchronization issue caused by a miss-used CountDownLatch, replaced with a Phaser +- Fixed a bug by which cached tasks didn't print out any result when 'echo' was set +- Fixed a bug in the timezone handling in the build timestamp diff --git a/changelog/nextflow/v0.3.3.mdx b/changelog/nextflow/v0.3.3.mdx new file mode 100644 index 000000000..3b10f612c --- /dev/null +++ b/changelog/nextflow/v0.3.3.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.3.3 +date: 2013-08-11 +tags: [nextflow] +--- + +- Added optional parameters to 'chunkLines' and 'chunkFasta' methods +- Added '-lib' command line parameter specify external libraries (.jar files) or extension scripts +- Folder 'lib' in the launch directory is added by as default libraries path +- Added 'tempFile()' and 'tempDir()' methods to BaseScript class +- The 'bin' directory in the script folder is added to the task PATH environment by default +- Upgraded to Groovy 2.1.6 +- Upgraded to Slf4j 1.7.5 +- Upgraded to Logback 1.0.13 diff --git a/changelog/nextflow/v0.3.4.mdx b/changelog/nextflow/v0.3.4.mdx new file mode 100644 index 000000000..2c1087c1c --- /dev/null +++ b/changelog/nextflow/v0.3.4.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.3.4 +date: 2013-08-24 +tags: [nextflow] +--- + +- Extending semantic for method File.copyTo(source,target) so that when 'target' argument + is a directory, it copies the 'source' file to that folder, with the same name as the original file. +- Bug: Fixed a ClassCastEx exception when the 'bin' folder is added to the PATH +- Bug: Fixed an issue that raised an error "error=26 Text file busy" on some platforms (CentOS) diff --git a/changelog/nextflow/v0.30.0.mdx b/changelog/nextflow/v0.30.0.mdx new file mode 100644 index 000000000..f6f1167c8 --- /dev/null +++ b/changelog/nextflow/v0.30.0.mdx @@ -0,0 +1,22 @@ +--- +title: Nextflow v0.30.0 +date: 2018-06-05 +tags: [nextflow] +--- + +- Added the support for Bioconda #493 +- Added support for AWS Batch job timeout #648 +- Added jobs submit rate limit #198 +- Added offline option #665 +- Enabling Java 9/10 support for build and launcher scripts #674 +- Fixed Expose Kubernetes Secrets to worker pods #651 +- Fixed K8s execution hangs when a non-existing docker image is specified #697 +- Fixed K8s execution terminates abruptly if a pod requires more resources than available ones #676 +- Fixed K8s executor does not report command log when a task fail #699 +- Fixed Configuration profile is not handled properly by the kuberun command #696 +- Fixed Enhance process metrics to avoid usage of ps tool #499 +- Fixed PublishDir should use copy mode by default when the target is a S3 path #718 +- Fixed Unbounded variable breaks task launcher script #722 +- Fixed Escape filenames when copying from S3 #717 +- Fixed AWS executor should use putObject API to upload job scripts to S3 #712 +- Fixed Exception is thrown when an output folder contains a circular symlink path #701 diff --git a/changelog/nextflow/v0.30.1.mdx b/changelog/nextflow/v0.30.1.mdx new file mode 100644 index 000000000..027985298 --- /dev/null +++ b/changelog/nextflow/v0.30.1.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v0.30.1 +date: 2018-06-11 +tags: [nextflow] +--- + +- Use a daemon thread for watchPath method #735 +- Fixed Gitlab API v3 has been deprecated and does not work any more #734 +- Fixed Unable to access params defined in the top scope from a nested profile #733 +- Fixed Process config selectors do not work when the config is included #729 +- Fixed Improve the error message when a missing property is used in the config file #730 +- Added Travis build support for jdk10 +- Added documentation for `until` operator #736 +- Added mailer recipients check +- Increased Singularity pull timeout to 20 minutes +- Updated build to Gradle 4.8 diff --git a/changelog/nextflow/v0.30.2.mdx b/changelog/nextflow/v0.30.2.mdx new file mode 100644 index 000000000..33ec9a3c3 --- /dev/null +++ b/changelog/nextflow/v0.30.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v0.30.2 +date: 2018-06-16 +tags: [nextflow] +--- + +- Fixed Output declarations with a glob pattern fail when AWS Batch executor is used #748 +- Fixed Scratch directive not working for AWS Batch executor #740 +- Fixed K8s launcher does not parse remote config files #738 +- Minor refactoring to enable Groovy 2.5 compilation 20b6d933 a8b994f1 diff --git a/changelog/nextflow/v0.31.0.mdx b/changelog/nextflow/v0.31.0.mdx new file mode 100644 index 000000000..4d06b88da --- /dev/null +++ b/changelog/nextflow/v0.31.0.mdx @@ -0,0 +1,38 @@ +--- +title: Nextflow v0.31.0 +date: 2018-07-25 +tags: [nextflow] +--- + +- Fixed CLI parameter value starting with a `-` is misinterpreted #808 +- Added keep-logs option to clean command #775 + +Already included in 0.31.0-RC1 +- Fixed K8s pod request should include resources spec when 1 cpu is specified #806 +- Fixed PBS executor should fail when submit response contains invalid data #753 +- Fixed SLURM executor fail to submit jobs when cluster option is specified #805 +- Fixed Allow the use relative paths for symlinks process input files #296 +- Fixed AWS batch jobs are not properly stopped when execution is interrupted #782 +- Fixed splitCsv is not properly handling blank lines #795 +- Fixed K8s pod runAsUser definition #707 +- Fixed Prevent NPE when K8s reports an empty pod state [dcc7ec5f] +- Fixed Allow list of patterns for fromPath and fromFilePairs channel factories #732 +- Fixed K8s execution hangs if an invalid pod secret file is specified #754 +- Fixed Correctly shutdown executor service #732 +- Fixed bug in dot rendering due to unquoted graph name when DOT language keyword used #783 +- Fixed Execution hangs if one or more inputs evaluate to null #764 +- Fixed Method `file` should thrown an error null is given as input #765 +- Fixed invalid relative link resolution with `readlink` +- Added AWS batch requests throttling handling #710 #709 +- Added AWS Batch parallel downloads/uploads [codefest] [8ba1716b,ba5ad7a8] +- Added K8s pod config and security context definition #707 +- Added Container env variables whitelist #803 +- Added support for K8s pod labels #762 +- Added support for K8s volume mount subPath #758 +- Added Nextflow required version in the config manifest #752 +- Added disk resource requirement in LSF executor #747 +- Added GA4GH TES executor [experimental] #794 +- Added System info to workflow metadata object #759 +- Added weblog feature #681 +- Deprecated process.$name syntax to define process specific settings #713 +- Upgrade to Gradle 4.9 diff --git a/changelog/nextflow/v0.31.1.mdx b/changelog/nextflow/v0.31.1.mdx new file mode 100644 index 000000000..22e78a5c0 --- /dev/null +++ b/changelog/nextflow/v0.31.1.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.31.1 +date: 2018-08-07 +tags: [nextflow] +--- + +- Fixed AWS Batch execution hangs when running on 1 cpu machine #825 +- Fixed AWS Batch fails if process tag length is too long #822 +- Fixed AWS Batch executor creates timeline report with missing time data #816 +- Added Ignite failure detection timeout configuration parameters #820 +- Added VersionNumber class to CacheHelper handler [90fb69fa] +- Added CONTRIBUTING file #564 diff --git a/changelog/nextflow/v0.32.0.mdx b/changelog/nextflow/v0.32.0.mdx new file mode 100644 index 000000000..c2463efef --- /dev/null +++ b/changelog/nextflow/v0.32.0.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v0.32.0 +date: 2018-09-27 +tags: [nextflow] +--- + +- Fixed CPU usage metrics can be wrongly reported #858 +- Fixed Allow a process to access input file metadata #731 +- Fixed AWS Batch Completed jobs are detected with a big delay #799 +- Fixed Misleading message is shown when pulling a project with a invalid config #863 +- Fixed Allow groupTuple operator to handle multi-size tuples #796 +- Fixed Ignite executor fills up logs when node is disconnected #810 +- Fixed Log filter option is misinterpreted when enclosed in double quotes #846 +- Fixed Metrics collector process may cause the main process to report a false non-zero exit status #836 +- Fixed K8s imagePullPolicy is not included in the pod spec #815 +- Fixed Splitter caching is too eager when caching path is specified #835 +- Fixed Improve error message for missing git provider configuration #847 +- Fixed Byte hashing is never reached in CacheHelper class (9ac81153) +- Fixed K8s launcher should not delete pod when `login` command fails (5175942a) +- Fixed Dump operator should nicely print ArrayBag content (91e371ba) +- Added manifest data in workflow metadata object #841 +- Added support for K8s imagePullSecrets pod attribute #800 +- Added option "checkIfExists" to Channel.fromPath method #666 +- Upgraded Apache Groovy to version 2.5.1 +- Upgraded Apache Ignite to version 2.6 +- Upgraded Slf4j to version 1.7.25 +- Upgraded Logback to version 1.1.11 +- Upgraded Grengine to version 1.3.0 +- Upgraded LevelDB to version 0.10 +- Upgraded Guava to version 21.0 +- Upgraded Spock to version 1.2 +- Using javax.activation:activation:1.1.1 (from com.sun.activation:javax.activation:1.2.0) diff --git a/changelog/nextflow/v0.5.1.mdx b/changelog/nextflow/v0.5.1.mdx new file mode 100644 index 000000000..18cb1a5a1 --- /dev/null +++ b/changelog/nextflow/v0.5.1.mdx @@ -0,0 +1,13 @@ +--- +title: Nextflow v0.5.1 +date: 2013-10-24 +tags: [nextflow] +--- + +- Major executors refactoring +- Featuring new single-thread tasks scheduler +- New enhanced DLS syntax with extended semantic +- Switched file handling to new NIO.2 file system +- Introducing support for DNAnexus cloud platform +- Removed unnecessary library dependencies +- Slim self-contained executable package diff --git a/changelog/nextflow/v0.5.2.mdx b/changelog/nextflow/v0.5.2.mdx new file mode 100644 index 000000000..b9060e52e --- /dev/null +++ b/changelog/nextflow/v0.5.2.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.5.2 +date: 2013-11-28 +tags: [nextflow] +--- + +- Changed caching hash function to murmur3_128 to avoid cache collision +- Fixed issue on process termination when resuming pipeline execution diff --git a/changelog/nextflow/v0.5.3.mdx b/changelog/nextflow/v0.5.3.mdx new file mode 100644 index 000000000..01eb1f33c --- /dev/null +++ b/changelog/nextflow/v0.5.3.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.5.3 +date: 2013-12-09 +tags: [nextflow] +--- + +- Fixed file close leaks +- Fixed DirectoryStream close leaks +- Enhanced process executor, supporting multiple executors in the same pipeline diff --git a/changelog/nextflow/v0.5.4.mdx b/changelog/nextflow/v0.5.4.mdx new file mode 100644 index 000000000..dcfda23a4 --- /dev/null +++ b/changelog/nextflow/v0.5.4.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.5.4 +date: 2013-12-10 +tags: [nextflow] +--- + +- Fixed an issue while checking an - empty - process exit file +- Fixed a race condition while resuming cached tasks diff --git a/changelog/nextflow/v0.6.0.mdx b/changelog/nextflow/v0.6.0.mdx new file mode 100644 index 000000000..1f436b5fa --- /dev/null +++ b/changelog/nextflow/v0.6.0.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.6.0 +date: 2014-01-16 +tags: [nextflow] +--- + +- New channel factory methods +- New reactive operators on channel objects (similar to RxJava) +- New shared parameters +- New input/output set parameters +- New conditional scripts using +- New groovy native processes diff --git a/changelog/nextflow/v0.6.1.mdx b/changelog/nextflow/v0.6.1.mdx new file mode 100644 index 000000000..03d6e10c2 --- /dev/null +++ b/changelog/nextflow/v0.6.1.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v0.6.1 +date: 2014-02-16 +tags: [nextflow] +--- + +- Added operator 'cross()' +- Added operator 'collate()' +- Added options 'remainder' to 'buffer()' operator +- Added 'deep' option to cache directive in order to index file content. +- Added Kryo based serialization +- Added 'storeDir' process directive to cache process results permanently +- Added 'watch' channel factory method that watches for files changes +- Added parametric input/output file names +- Renaming "mapMany" to "flatMap" +- Enhanced stability for grid executors +- SGE executor periodically invokes the 'qstat' command to fetch the queue jobs status +- Processes and executors can be configured separately in the configuration file by using the $name special scope +- Completed Path methods extension equivalent to legacy File +- Reporting a random tip when a process fail diff --git a/changelog/nextflow/v0.6.2.mdx b/changelog/nextflow/v0.6.2.mdx new file mode 100644 index 000000000..83b56ed83 --- /dev/null +++ b/changelog/nextflow/v0.6.2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v0.6.2 +date: 2014-03-12 +tags: [nextflow] +--- + +- Added 'concat' operator to concatenate two or more channels +- Added 'into(ch1,ch2...)' operator which maps items in a tuple into the corresponding target channels +- Implemented queue status check for SLURM grid executor +- Implemented queue status check for LSF grid executor +- Improved grid executors stability diff --git a/changelog/nextflow/v0.7.0.mdx b/changelog/nextflow/v0.7.0.mdx new file mode 100644 index 000000000..8e0cda8d0 --- /dev/null +++ b/changelog/nextflow/v0.7.0.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v0.7.0 +date: 2014-03-24 +tags: [nextflow] +--- + +- New self-downloadable and self-updatable script launcher +- New cluster mode, Nextflow can run as a daemon node by using Hazelcast cluster (incubating) +- New support for Docker containers. Any process can be executed through Docker adding 'container = name' in the process definition (incubating) +- New cluster distributed execution for native processes (groovy closures) +- Enhanced task polling monitor +- Use 'rsync' to unstage task result files to target directory +- Pipeline execution can be launched in background by adding the option '-bg- to the command line +- Updated documentation diff --git a/changelog/nextflow/v0.7.1.mdx b/changelog/nextflow/v0.7.1.mdx new file mode 100644 index 000000000..6c177456b --- /dev/null +++ b/changelog/nextflow/v0.7.1.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v0.7.1 +date: 2014-04-15 +tags: [nextflow] +--- + +- Fixed an issue with 'scratch' directive i.e. Fixed issue when copying a symlink +- Added 'Retry' error handling strategy and 'maxRetries' and 'maxErrors' process directives +- Added GridGain cluster sub-module +- Added TaskDispatcher submit, start, complete and error listeners +- Added new ServiceDiscovery to handle sub-modules executors +- Added Map#getOrCreate() extension method +- Using @CompileStatic for AST transformation +- Removing unused APP_TMP_DIR const +- Renamed class 'AbstractExecutor' to 'Executor' +- Added ProcessFactory class +- Refactored sub-modules directory structure +- Define the default 'lib' path relative to the pipeline 'baseDir' i.e. relative to the main script location +- Save the history entry just before launch the execution diff --git a/changelog/nextflow/v0.7.2.mdx b/changelog/nextflow/v0.7.2.mdx new file mode 100644 index 000000000..83764c55b --- /dev/null +++ b/changelog/nextflow/v0.7.2.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.7.2 +date: 2014-05-05 +tags: [nextflow] +--- + +- Enhanced support for Docker containers: + Now the current user id is added on the Docker command line + and /tmp folder in the container is mounted on a temporary path in the host disk diff --git a/changelog/nextflow/v0.7.3.mdx b/changelog/nextflow/v0.7.3.mdx new file mode 100644 index 000000000..f77a50bd5 --- /dev/null +++ b/changelog/nextflow/v0.7.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.7.3 +date: 2014-05-16 +tags: [nextflow] +--- + +Enhanced stability and errors reporting diff --git a/changelog/nextflow/v0.8.0.mdx b/changelog/nextflow/v0.8.0.mdx new file mode 100644 index 000000000..29789c9af --- /dev/null +++ b/changelog/nextflow/v0.8.0.mdx @@ -0,0 +1,24 @@ +--- +title: Nextflow v0.8.0 +date: 2014-05-23 +tags: [nextflow] +--- + +- Added support for Java 8 +- Upgraded to Groovy 2.3.0 +- Upgraded to Kryo 2.24.0 +- New splitter operators: 'splitText', 'splitFasta', 'splitFastq', 'splitCsv' +- New operator 'collectFile' to gather file chunks +- New operator Channel.fromPath which allows fine control on paths traversal +- Operator Channel.from has been deprecated in favor of Channel.fromPath +- Operator Channel.watch has been deprecated in favor of Channel.watchPath +- Clean-up API for operators: 'into', 'choice', 'separate', 'filter' +- Operator 'grep' has been removed and features included in 'filter' operator +- Deprecated 'chopXxx' operators +- Deprecated 'chunkXxx' operators +- Deprecated 'each' operator in favor of 'subscribe' +- Deprecated process 'merge' directive +- Executor service now uses a fixed thread pool +- Fixed issue on 'maxForks' process directive +- Added 'info' cli parameter +- Improved documentation diff --git a/changelog/nextflow/v0.8.1.mdx b/changelog/nextflow/v0.8.1.mdx new file mode 100644 index 000000000..bcc9b1c39 --- /dev/null +++ b/changelog/nextflow/v0.8.1.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v0.8.1 +date: 2014-05-26 +tags: [nextflow] +--- + +- Fixed a ConcurrentModificationException issue on splitXxx method due to a misused Memoized annotation diff --git a/changelog/nextflow/v0.8.2.mdx b/changelog/nextflow/v0.8.2.mdx new file mode 100644 index 000000000..0c3dd822e --- /dev/null +++ b/changelog/nextflow/v0.8.2.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.8.2 +date: 2014-06-18 +tags: [nextflow] +--- + +- Fixed issue #7 - NoClassDefFoundError HashMap$Entry exception with Java 8 +- Enhanced launch script: removed '-Xms' Java option; verify the Java version coherent with JAVA_HOME definition; improved error messages. diff --git a/changelog/nextflow/v0.8.3.mdx b/changelog/nextflow/v0.8.3.mdx new file mode 100644 index 000000000..80adc07f3 --- /dev/null +++ b/changelog/nextflow/v0.8.3.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v0.8.3 +date: 2014-06-27 +tags: [nextflow] +--- + +- Added support for Modules package maages +- Fixed issue #1 -- process hung when only a parameter of type 'each' is defined +- Fixed issue #6 -- exception while resuming a process that declares a parametric file output name +- Fixed support for curly brackets glob path matching in Channel.fromPath +- Updated Groovy runtime to 2.3.3 +- Updated to Groovy-nio module in place of 'native' implementation diff --git a/changelog/nextflow/v0.8.4.mdx b/changelog/nextflow/v0.8.4.mdx new file mode 100644 index 000000000..4f9784ba2 --- /dev/null +++ b/changelog/nextflow/v0.8.4.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v0.8.4 +date: 2014-07-20 +tags: [nextflow] +--- + +- Upgrade to Groovy 2.3.4 +- Fixed method Path.list() +- Added '-notify' option to SGE qsub command to handle killed jobs correctly diff --git a/changelog/nextflow/v0.8.5.mdx b/changelog/nextflow/v0.8.5.mdx new file mode 100644 index 000000000..7ba7c1a90 --- /dev/null +++ b/changelog/nextflow/v0.8.5.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v0.8.5 +date: 2014-08-03 +tags: [nextflow] +--- + +- Upgraded to Groovy 2.3.6 +- Added '-noverify' to JVM launcher options as workaround for Java bug JDK-8051012 diff --git a/changelog/nextflow/v0.9.0.mdx b/changelog/nextflow/v0.9.0.mdx new file mode 100644 index 000000000..ce7420b40 --- /dev/null +++ b/changelog/nextflow/v0.9.0.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v0.9.0 +date: 2014-08-11 +tags: [nextflow] +--- + +- Added GitHub/Git support. It allows one to pull and run pipelines published on a + remote GitHub repository +- Changed command line structure. Since this version it is organised in sub-commands. + The following sub-commands are available: + - ls: list all downloaded pipelines; + - run: launch a pipeline execution; + - pull: download or update a pipeline hosted on GitHub; + - info: show pipeline information; + - drop: remote a locally stored pipeline; + - clone: copy a pipeline to a directory specified; + - history: list all pipeline runs; + - help: show program help. +- Added 'baseDir' and 'workDir' script variables +- Removed Merge processor diff --git a/changelog/nextflow/v18.10.1.mdx b/changelog/nextflow/v18.10.1.mdx new file mode 100644 index 000000000..133dca130 --- /dev/null +++ b/changelog/nextflow/v18.10.1.mdx @@ -0,0 +1,37 @@ +--- +title: Nextflow v18.10.1 +date: 2018-10-24 +tags: [nextflow] +--- + +- Fixed test [011e8e23] +- Fixed version number check [fb780347] +- Added lenient cache mode #828 [ba907a2f] +- Added support for java 11 [60da50b5] +- Added support for Singularity 3.0 library #898 +- Added support for AWS Batch hybrid executions #744 +- Added weblog JSON format docs #882 +- Added weblog example documentation #891 +- Added PbsPro executor [33ae1104] +- Added support for ANSI console logging [9c14a947] +- Fixed License prevents scientific use #788 +- Fixed process submitter slow-down [495e900a] +- Fixed Comparing duration and memory units with null throws an exception #872 +- Fixed Html format dag fails when 'each' qualifier is used #887 +- Fixed Collate/Buffer hangs with one emission after Collect operator #868 +- Fixed Option checkIfExists should be applied when a glob pattern does not match any file #874 +- Fixed Add name to manifest and reject other attributes #871 +- Fixed warning message grammar when resuming on new project #885 +- Fixed Missing DSL Xform transformation in console execution [9621f8c6] +- Fixed Enum declared in nextflow script causes error #878 +- Fixed Report a warning message when queue status fetch fails [39aae6a2] +- Fixed Pbs executor may return nonzero exit code when checking queue status #904 +- Renamed weblog `runStatus` to `event` #892 +- Renamed K8s config attribute userDir to launchDir #895 +- Merged tests as subtree [a03eb59a] +- Refactored service discovery +- Removed FastXxxYyyyStream +- Demoted igfs subsystem +- Upgraded Groovy to version 2.5.3 [119300b3] +- Upgrade Gradle to version 4.10 +- Updated AWS batch docs diff --git a/changelog/nextflow/v18.11.0-edge.mdx b/changelog/nextflow/v18.11.0-edge.mdx new file mode 100644 index 000000000..9d5bfc500 --- /dev/null +++ b/changelog/nextflow/v18.11.0-edge.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v18.11.0-edge +date: 2018-11-12 +tags: [nextflow] +--- + +- Added More duration and memory unit syntax sugar #921 +- Added NO_PROXY env variable should be honoured #864 +- Added keepHeader option to splitText operator #912 +- Fixed Invalid warning message for config selector #905 +- Fixed Queue status command fail on LSF version 8 #910 +- Fixed Use `bash` instead of `sh` to fetch queue status [0dc25480] +- Better report warning when grid status command fails [3ac8b972] +- Fixed RejectedExecutionException on successive Console executions #906 diff --git a/changelog/nextflow/v18.12.0-edge.mdx b/changelog/nextflow/v18.12.0-edge.mdx new file mode 100644 index 000000000..b3801534e --- /dev/null +++ b/changelog/nextflow/v18.12.0-edge.mdx @@ -0,0 +1,30 @@ +--- +title: Nextflow v18.12.0-edge +date: 2018-12-18 +tags: [nextflow] +--- + +- Add Google Cloud Platform integration +- Added support for K8s nodeSelector #955 +- Added new AWS regions #935 +- Added json/yaml output to info command #657 +- Fixed remote bin directory when using buckerDir option [6d796783] +- Fixed foreign file system detection [1489cc72] +- Fixed Ansi logger division by zero [ae2b1380] +- Fixed Unparseable Data format on http file #962 +- Fixed Log command history #405 +- Fixed Too long process tag name can cause SLURM failure #941 +- Fixed LSF can return an inconsistent jobs status #927 +- Fixed dump last queue status on failure [36e80242] +- Fixed Allow the usage of a custom docker image for K8s driver pod #877 +- Fixed K8s executor when the cluster has no available cpus #824 +- Fixed Prevent duplicate process definitions #920 +- Fixed Update queue statuses used by PBS Pro #908 +- Fixed K8s launcher fails to set pod work directory [dc8bfead] +- Fixed cmd cloud error message [14d603b9] +- Improved script runner api [da4a6c17] +- Revert "Apache Ignite to version 2.6" #909 +- Fixed Invalid config rendering #801 +- Improved file hashing logging [0d35b2b4] +- Refactored ScriptRunner class [15ee2f1c] +- Refactored DSL code visitor [67904c1f] diff --git a/changelog/nextflow/v19.01.0-edge.mdx b/changelog/nextflow/v19.01.0-edge.mdx new file mode 100644 index 000000000..deaaf02c1 --- /dev/null +++ b/changelog/nextflow/v19.01.0-edge.mdx @@ -0,0 +1,25 @@ +--- +title: Nextflow v19.01.0-edge +date: 2019-01-10 +tags: [nextflow] +--- + +- Enhanced timeline and execution reports #985 #986 [fb00c3a6] [092f0b9e] +- Enhanced BashWrapperBuilder using template file [7d7e116a] [c62b9dff] +- Fixed CPU usage accounting #982 [7d7e116a] [c62b9dff] +- Fixed Move output files to storeDir instead of copying them #745 +- Fixed Interpolated strings in a from statement are misinterpreted #978 +- Fixed Launcher fails with Java 10 or later #953 +- Fixed LSF long user names breaks jobs status parsing [b4306151] #988 +- Fixed Memory unit should contain thousand separator [e6ec4c84] #989 +- Fixed Allows fromFilePairs to handle non globs #946 +- Added an env variable to define default cloud driver #973 +- Added countLines, countFasta and countFastq methods #972 +- Added NXF_DIST launcher variable #954 +- Added NXF_SMOKE var to disable long running tests +- Deprecated groupBy and route operators [b7ca53d2] +- Updated S3 storage classes #977 +- Updated groovy to version 2.5.5 +- Updated copyright disclaimer +- Refactored project structure [516294e7] +- Speed-up CI tests [3320dcec] diff --git a/changelog/nextflow/v19.01.0.mdx b/changelog/nextflow/v19.01.0.mdx new file mode 100644 index 000000000..7801022b5 --- /dev/null +++ b/changelog/nextflow/v19.01.0.mdx @@ -0,0 +1,47 @@ +--- +title: Nextflow v19.01.0 +date: 2019-01-22 +tags: [nextflow] +--- + +- Added Google Cloud Platform integration +- Added support for K8s nodeSelector #955 +- Added new AWS regions #935 +- Added json/yaml output to info command #657 +- Added More duration and memory unit syntax sugar #921 +- Added NO_PROXY env variable should be honoured #864 +- Added keepHeader option to splitText operator #912 +- Added countLines, countFasta and countFastq methods #972 +- Added an env variable to define default cloud driver #973 +- Fixed Unable to find JVM 1.8 err message #1000 +- Fixed Memory unit should contain thousand separator [e6ec4c84] #989 +- Fixed LSF long user names breaks jobs status parsing [b4306151] #988 +- Fixed Move output files to storeDir instead of copying them #745 +- Fixed Interpolated strings in a from statement are misinterpreted #978 +- Fixed ConcurrentModificationException when publishing output files #971 +- Fixed Launcher fails with Java 10 or later #953 +- Fixed remote bin directory when using bucketDir option [6d796783] +- Fixed foreign file system detection [1489cc72] +- Fixed Ansi logger division by zero [ae2b1380] +- Fixed Unparseable Data format on http file #962 +- Fixed Log command history #405 +- Fixed Too long process tag name can cause SLURM failure #941 +- Fixed LSF can return an inconsistent jobs status #927 +- Fixed dump last queue status on failure [36e80242] +- Fixed Allow the usage of a custom docker image for K8s driver pod #877 +- Fixed K8s executor when the cluster has no available cpus #824 +- Fixed Prevent duplicate process definitions #920 +- Fixed Update queue statuses used by PBS Pro #908 +- Fixed K8s launcher fails to set pod work directory [dc8bfead] +- Fixed cmd cloud error message [14d603b9] +- Fixed RejectedExecutionException on successive Console executions #906 +- Fixed Invalid config rendering #801 +- Fixed Invalid warning message for config selector #905 +- Fixed Queue status command fail on LSF version 8 #910 +- Fixed Use `bash` instead of `sh` to fetch queue status +- Improved script runner api [da4a6c17] +- Improved file hashing logging [0d35b2b4] +- Refactored ScriptRunner class [15ee2f1c] +- Refactored DSL code visitor [67904c1f] +- Revert "Apache Ignite to version 2.6" #909 +- Better report warning when grid status command fails [3ac8b972] diff --git a/changelog/nextflow/v19.02.0-edge.mdx b/changelog/nextflow/v19.02.0-edge.mdx new file mode 100644 index 000000000..7b3ad6aa8 --- /dev/null +++ b/changelog/nextflow/v19.02.0-edge.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v19.02.0-edge +date: 2019-02-06 +tags: [nextflow] +--- + +- Added foreign files caching ability #686 +- Added Ansi logging as default console output +- Added Gitea source code provider [ae04fc37] (credits Akira Sekiguchi) +- Fixed Join operator returns invalid remainder values #1015 +- Fixed Invalid trigger of integration tests [7aa5908a] +- Fixed memory allocation for SGE executor [29353c90] +- Fixed properties access for TaskConfig and LazyMap [09b74a52] +- Fixed Invalid decimal separator in mem unit string #999 +- Fixed tail error on launcher script [38afea6c] +- Improved Execution and Timeline memory reporting #980 #986 #1012 #1014 #1016 #1018 [01426097] [7d6c29f0] (credits Philippe Hupé) +- Improved Google pipelines file copy strategy [678405b2] +- Improved output file stage out behaviour docs #961 #1013 +- Upgraded Groovy runtime to version 2.5.6 diff --git a/changelog/nextflow/v19.03.0-edge.mdx b/changelog/nextflow/v19.03.0-edge.mdx new file mode 100644 index 000000000..62ce0b4ea --- /dev/null +++ b/changelog/nextflow/v19.03.0-edge.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v19.03.0-edge +date: 2019-03-14 +tags: [nextflow] +--- + +- Fix Nextflow hangs submitting jobs to AWS batch #1024 +- Fix process builder incomplete output [2fe1052c] +- Fix Grid executor reports invalid queue status #1045 +- Fix Script execute permission is lost in container #1060 +- Fix K8s serviceAccount is not honoured #1049 +- Fix K8s kuberun login path #1072 +- Fix K8s imagePullSecret and imagePullPolicy #1062 +- Fix Google Storage docs #1023 +- Fix Env variable NXF_CONDA_CACHEDIR is ignored #1051 +- Fix failing task due to legacy sleep command [3e150b56] +- Fix SplitText operator should accept a closure parameter #1021 +- Add Channel.fromSRA factory method #1070 +- Add voluntary/involuntary context switches to metrics #1047 +- Add noHttps option to singularity config #1041) +- Add docker-daemon Singularity support #1043 [dfef1391] +- Use peak_vmem and peak_rss as default output in the trace file instead of rss and vmem #1020 +- Improve ansi log rendering #996 [33038a18] diff --git a/changelog/nextflow/v19.04.0-edge.mdx b/changelog/nextflow/v19.04.0-edge.mdx new file mode 100644 index 000000000..f17ad0573 --- /dev/null +++ b/changelog/nextflow/v19.04.0-edge.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v19.04.0-edge +date: 2019-04-24 +tags: [nextflow] +--- + +- Add Experimental support for gpu resources #997 +- Fix LSF executor should use mem setting in lsf.config #1124 +- Fix Unable to list S3 bucket content #1121 diff --git a/changelog/nextflow/v19.04.0.mdx b/changelog/nextflow/v19.04.0.mdx new file mode 100644 index 000000000..302b16ad0 --- /dev/null +++ b/changelog/nextflow/v19.04.0.mdx @@ -0,0 +1,51 @@ +--- +title: Nextflow v19.04.0 +date: 2019-04-17 +tags: [nextflow] +--- + +- Added support for NCBI_API_KEY variable [e4d9b62c] +- Added warning message when using untested Java version [35acd1cb] +- Added parameter and workflow metadata to weblog payload #1077 +- Added warning on publish with a null var [7d58bfb7] [95c219fb] +- Fixed Echo directive when Ansi log is enabled #1112 #996 +- Fixed Do not mount inputs when `stageInMode == copy` #1105 +- Fixed `splitCsv` operator fails to parse values containing commas #1102 +- Fixed missing return type for Date.format method +- Fixed Channel operations `toList` followed by `merge` hang execution #1083 +- Avoid printing execution summary when no processes are computed #996 +- Improved error reporting for null publishDir [0b9b52f0] + +(from 19.03.0-edge) +- Fix Nextflow hangs submitting jobs to AWS Batch #1024 +- Fix process builder incomplete output [2fe1052c] +- Fix Grid executor reports invalid queue status #1045 +- Fix Script execute permission is lost in container #1060 +- Fix K8s serviceAccount is not honoured #1049 +- Fix K8s kuberun login path #1072 +- Fix K8s imagePullSecret and imagePullPolicy #1062 +- Fix Google Storage docs #1023 +- Fix Env variable NXF_CONDA_CACHEDIR is ignored #1051 +- Fix failing task due to legacy sleep command [3e150b56] +- Fix SplitText operator should accept a closure parameter #1021 +- Add Channel.fromSRA factory method #1070 +- Add voluntary/involuntary context switches to metrics #1047 +- Add noHttps option to singularity config #1041) +- Add docker-daemon Singularity support #1043 [dfef1391] +- Use peak_vmem and peak_rss as default output in the trace file instead of rss and vmem #1020 +- Improve ansi log rendering #996 [33038a18] + +(from 19.02.0-edge) +- Added foreign files caching ability #686 +- Added Ansi logging as default console output +- Added Gitea source code provider [ae04fc37] +- Fixed Join operator returns invalid remainder values #1015 +- Fixed Invalid trigger of integration tests [7aa5908a] +- Fixed memory allocation for SGE executor [29353c90] +- Fixed properties access for TaskConfig and LazyMap [09b74a52] +- Fixed Invalid decimal separator in mem unit string #999 +- Fixed tail error on launcher script [38afea6c] +- Improved Execution and Timeline memory reporting #980 #986 #1012 #1014 #1016 #1018 [01426097] [7d6c29f0] +- Improved Google pipelines file copy strategy [678405b2] +- Improved output file stage out behaviour docs #961 #1013 +- Upgraded Groovy runtime to version 2.5.6 diff --git a/changelog/nextflow/v19.04.1.mdx b/changelog/nextflow/v19.04.1.mdx new file mode 100644 index 000000000..610b510fc --- /dev/null +++ b/changelog/nextflow/v19.04.1.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v19.04.1 +date: 2019-05-03 +tags: [nextflow] +--- + +- Fix Println operator output is not shown with ansi logging #1137 diff --git a/changelog/nextflow/v19.05.0-edge.mdx b/changelog/nextflow/v19.05.0-edge.mdx new file mode 100644 index 000000000..be8fa6329 --- /dev/null +++ b/changelog/nextflow/v19.05.0-edge.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v19.05.0-edge +date: 2019-05-20 +tags: [nextflow] +--- + +- Add Aws Batch maxParallelTransfers config #1107 [26d37556] +- Add `NXF_ANSI_SUMMARY` var to disable log summary [d4b9cc44] +- Add support for AWS user volumes and jobRoleArn [651eeadd] +- Add Support for LSF per task resource reserve mode #1071 +- Fix Env variable with blanks is not resolved correctly in containers #1146 +- Fix method `isDynamic` visibility [f241781b] +- Fix `WebLogObserver` data leak on completion #1010 +- Fix unit test execution [622d97d4] +- Fix Quiet cli option is not honoured [e656e4b0] +- Fix Log messages don't show in the console #1129 [95f4dd7b] +- Fix nextflow build timestamp json rendering [af6584c9] +- Fix Launcher should return non-zero exit when fail to setp env #1126 +- Update get started docs [68f53367] +- Update aws sdk to version 1.11.542 +- Update created label in timestamp [e8945e8b] +- Update readme IDE version +- Refactor AWS cli path option [ad9af0dd] +- Improve Dsl-2 error reporting [4e2621ff] +- Improve CI tests scripts [febeb530] +- Improve docs for config profiles [8cf95a5d] +- Syntax enhancement aka DLS-2 #984 [651af95a] +- Print summary only the run takes > 3mins [cd459713] +- Render last tag along with the process name #1144 [8cf8cc44] +- Sync build scripts [a5689217] +- Provide scm credentials when fetching information about remote branches #1135 [808847b5] +- Code cleanup [2322fbcf] diff --git a/changelog/nextflow/v19.06.0-edge.mdx b/changelog/nextflow/v19.06.0-edge.mdx new file mode 100644 index 000000000..c8c4c4419 --- /dev/null +++ b/changelog/nextflow/v19.06.0-edge.mdx @@ -0,0 +1,21 @@ +--- +title: Nextflow v19.06.0-edge +date: 2019-06-21 +tags: [nextflow] +--- + +- Fix Nextflow indefinitely waiting for killed jobs #981 +- Fix Suppress Unknown hashing type logging message #1178 [a005b1b0] +- Fix a typo in AWS docs (#1171) +- Fix Invalid response cause Google pipelines exec to crash #1163 +- Fix kuberun doesn't delete config maps #1165 +- Fix Disable ansi logging when using kuberun command #1161 +- Fix comparable test with groovy 2.5.8 [3d1c0833] +- Fix Unexpected config selector warning #1167 [52e70e31] +- Fix Kuberun should honour `-bg` (background) option #1159 [4b160b7b] +- Add S3 download retry (#1164) +- Upgrade BitBucket provider with API 2.0 [feeddcda] +- Print ansi summary for exec > 60 secs [53c94270] +- Remove deprecated countText operator #983 +- Demote warmup into to debug level [c7d08337] +- Demote barrier logging to trace level [5b7234a1] diff --git a/changelog/nextflow/v19.07.0-edge.mdx b/changelog/nextflow/v19.07.0-edge.mdx new file mode 100644 index 000000000..54d196321 --- /dev/null +++ b/changelog/nextflow/v19.07.0-edge.mdx @@ -0,0 +1,18 @@ +--- +title: Nextflow v19.07.0-edge +date: 2019-07-09 +tags: [nextflow] +--- + +- Fix Remote input file download slowdown submission rate #1206 [b710e21e] +- Fix serial publishDir uploads #856 [14774854] +- Fix Trace file option is not honoured #1217 +- Fix Custom lib path is not added to the classpath #1213 +- Fix Discovery executor tracing error [3e26c146] +- Add megabyte unit to Slurm memory requirement #1216 [efabdd2f] +- Add support for GCP dynamic machine type #1198 [5c2c7665] +- Add setCredentialsProvider for submodules #1205 [e2460414] +- Improve google pipelines docs [aed407ed] +- Improve FileTransfer await termination log #1206 [cb968da7] +- Allow trace logging for com.upplication.s3fs package [d71b94e1] +- Upgrade s3fs lib to version 1.0.6 #856 diff --git a/changelog/nextflow/v19.07.0.mdx b/changelog/nextflow/v19.07.0.mdx new file mode 100644 index 000000000..6eee9e168 --- /dev/null +++ b/changelog/nextflow/v19.07.0.mdx @@ -0,0 +1,72 @@ +--- +title: Nextflow v19.07.0 +date: 2019-07-27 +tags: [nextflow] +--- + +- Add support for K8s annotations #1240 [8eeb7f9f] +- Add support for Moab resource manager #1224 [3ba51a19] +- Add Pbs Pro execution documentation [1d39ab31] +- Add code of conduct document +- Fix missing LFS executor register invocation #1234 [b1b7ab1] +- Fix "invalid pod status" when running scrips with the kubernetes executor #1242 [11caac68] +- Revert Fix Environment activation fails with recent versions of Conda #1195 [98c0d1f8] + +(from 19.07.0-edge) +- Fix Remote input file download slowdown submission rate #1206 [b710e21e] +- Fix serial publishDir uploads #856 [14774854] +- Fix Trace file option is not honoured #1217 +- Fix Custom lib path is not added to the classpath #1213 +- Fix Discovery executor tracing error [3e26c146] +- Add megabyte unit to Slurm memory requirement #1216 [efabdd2f] +- Add support for GCP dynamic machine type #1198 [5c2c7665] +- Add setCredentialsProvider for submodules #1205 [e2460414] +- Improve google pipelines docs [aed407ed] +- Improve FileTransfer await termination log #1206 [cb968da7] +- Allow trace logging for `com.upplication.s3fs` package [d71b94e1] +- Upgrade s3fs lib to version 1.0.6 #856 + +(from 19.06.0-edge) +- Fix Nextflow indefinitely waiting for killed jobs #981 +- Fix Suppress Unknown hashing type logging message #1178 [a005b1b0] +- Fix a typo in AWS docs (#1171) +- Fix Invalid response cause Google pipelines exec to crash #1163 +- Fix kuberun doesn't delete config maps #1165 +- Fix Disable ansi logging when using kuberun command #1161 +- Fix comparable test with groovy 2.5.8 [3d1c0833] +- Fix Unexpected config selector warning #1167 [52e70e31] +- Fix Kuberun should honour `-bg` (background) option #1159 [4b160b7b] +- Add S3 download retry (#1164) +- Upgrade BitBucket provider with API 2.0 [feeddcda] +- Print ansi summary for exec > 60 secs [53c94270] +- Remove deprecated countText operator #983 +- Demote warmup into to debug level [c7d08337] +- Demote barrier logging to trace level [5b7234a1] + +(from 19.05.0-edge) +- Add Aws Batch maxParallelTransfers config #1107 [26d37556] +- Add NXF_ANSI_SUMMARY var to disable log summary [d4b9cc44] +- Add support for AWS user volumes and jobRoleArn [651eeadd] +- Add Support for LSF per task resource reserve mode #1071 +- Fix Env variable with blanks is not resolved correctly in containers #1146 +- Fix method isDynamic visibility [f241781b] +- Fix WebLogObserver data leak on completion #1010 +- Fix unit test execution [622d97d4] +- Fix Quiet cli option is not honoured [e656e4b0] +- Fix Log messages don't show in the console #1129 [95f4dd7b] +- Fix nextflow build timestamp json rendering [af6584c9] +- Fix Launcher should return non-zero exit when fail to step env #1126 +- Update get started docs [68f53367] +- Update aws sdk to version 1.11.542 +- Update created label in timestamp [e8945e8b] +- Update readme IDE version +- Refactor AWS cli path option [ad9af0dd] +- Improve Dsl-2 error reporting [4e2621ff] +- Improve CI tests scripts [febeb530] +- Improve docs for config profiles [8cf95a5d] +- Syntax enhancement aka DLS-2 #984 [651af95a] +- Print summary only the run takes > 3mins [cd459713] +- Render last tag along with the process name #1144 [8cf8cc44] +- Sync build scripts [a5689217] +- Provide scm credentials when fetching information about remote branches #1135 [808847b5] +- Code cleanup [2322fbcf] diff --git a/changelog/nextflow/v19.08.1-edge.mdx b/changelog/nextflow/v19.08.1-edge.mdx new file mode 100644 index 000000000..3cfbe1711 --- /dev/null +++ b/changelog/nextflow/v19.08.1-edge.mdx @@ -0,0 +1,58 @@ +--- +title: Nextflow v19.08.1-edge +date: 2019-08-26 +tags: [nextflow] +--- + +- Add Process named output channels #1290 [DSL] [6a756fd2] +- Add workflow publish directive [DLS2] [287a095e] +- Add stageAs option to input path [DSL2] [9b5f55f6] +- Add workflow entry option [DSL2] [f29e3e04] +- Add extension to module file name instead of simpleName [DSL2] [71a60365] +- Add support AWS temporary session token support [15ac3938] +- Add support for GCP disk resource [72bb9c41] +- Add fork operator #1281 [DSL2] [6f89833a] +- Add branch operator #1202 [706a182a] [DSL2] +- Add workflow definition and composition #1276 [13f43291] [DSL2] +- Add projectName to workflow metadata [55be0762] +- Add support for tower [1255f702] +- Add support for timezoned timestamp to metadata [6f4a2e28] +- Add task pending event [d2d66698] +- Add support for path in/out qualfier [DSL2] #1201 [5552b38a] +- Add set chainable operator #1262 [2651a099] +- Fix name generator uniq check [0bbf7015] +- Fix execution report nested processes aggregation [e4fad827] +- Fix nested process names config resolution [ccd8e833] +- Fix missing deprecation [8af85189] +- Fix broken div structure in html report [3e055a7a] +- Fix set operator for multi-channel #1262 [eab39378] [DSL2] +- Fix typo in the `delete` file docs [38fa2dca] +- Fix test #1276 [cc03d76b] +- Fix classpath resolving when launched from foreign path [04024fe6] +- Fix console cmd throws runtime exception #1273 [2f78d943] +- Fix process names validation fails for included modules #1175 [75b96aa8] [DSL2] +- Fix issue with `set` as operator #1262 +- Fix misleading name when throwing multiple in/out channel [e7c8cdb9] +- Fix Combine operation incorrectly represented in DAG #1268 [6e86e28a] +- Fix docs collectFile `size` vs `skip` option [8cfb5a64] +- Fix K8s TaskHandler updates its status correctly to 'RUNNING' (#1256) [a1457a1c] +- Remove potential sensitive environment vars #1075 [a413b967] +- Enable use AWS profiles other than `default` (#1248) [d7434773] +- Relax deprecation messages #1269 [454e78f1] [fd11f8d8] +- Defer process start and channel emission [DSL2] [f5eef256] +- Rename ChannelFactory helper to CH [4b5b3c7e] +- Improve modules error checking and reporting [aa650b9e] [DSL2] +- Increase build test max heap size [daca896e] +- Upgrade Gradle to version 5.5.1 [027cb16b] +- Enforce process execution in `workflow` scope` [DSL2] [bca15a91] [0a582240] +- Replace InterruptedException with TimeoutException in GCP test [a6d3c24c] +- Explicitly check whether module path does not end with .nf (#1254) [8253608a] +- Minor improvement AWS Batch docs [bd56ea44] +- Upgrade Groovy to version 2.5.8 [36dffa18] +- Enhance execution report [ab5f8d98] +- Enhance simple http client [2e0f5c2b] +- Refactor resource metrics collector [fec86ed2] +- Refactor observers plugin system [9dab8f08] +- Replace input/output set type with tuple [DSL2] #1207 [5e19f72f] +- Convert any simple object to a value channel [DSL2] [86b0469d] +- Improve logging [5adc2c09] diff --git a/changelog/nextflow/v19.09.0-edge.mdx b/changelog/nextflow/v19.09.0-edge.mdx new file mode 100644 index 000000000..8d6001c6e --- /dev/null +++ b/changelog/nextflow/v19.09.0-edge.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v19.09.0-edge +date: 2019-09-16 +tags: [nextflow] +--- + +- Add `of` and `fromList` channel factories [cc60b305] +- Add nf-tower init request [120ed8ba] +- Add support for accelerator directive #997 [624c8e83] +- Add support for native shifterimg for shifter engine (#1292) [a106712e] +- Add nf-tower subproject [285e09ce] +- Add sticky log marker [f9a3c9da] +- Add support for config resolution [4754abc6] +- Add enable option to publishDir [7b9c2d2f] +- Fix race condition on task workdir creation [5bc323a0] +- Fix issue when fetching aws profile from env #1248 [ba30b97c] +- Fix minor issue when reporting invalid entry error msg [814d6728] +- Fix non determinist test failure [a9289e9e] +- Throw error cause on InovationTargetException [9e1467d0] +- Remove verbos logs on readExitFile check [a5a6a1fc] +- Revert "Patch capsule error message" [ac4ac073] +- Patch for inconsistent cached task id #1301 [7bfd0008] +- Improve flow execution events [335b76d1] diff --git a/changelog/nextflow/v19.10.0.mdx b/changelog/nextflow/v19.10.0.mdx new file mode 100644 index 000000000..51fdfb2f9 --- /dev/null +++ b/changelog/nextflow/v19.10.0.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v19.10.0 +date: 2019-10-21 +tags: [nextflow] +--- + +- Merge Use a delete function that doesn't follow symlinks #1337 +- Merge Allow multiple mounts for the same K8s claim name [1d288a3d] #1284 +- Make Google Pipelines logging less verbose [6edd9954] +- Merge Shifterimg workaround for ensuring image pulls #1327 +- Merge Add ENDPOINT support for China regions #1323 [636cbfb5] +- Add limit on max field lengths sent by Tower [4d5cabc2] +- Add retry ability to Tower client for 500 class errors [c7f70fc5] +- Add support for Java 12 #1082 [b86b2da0] +- Add BitBucket Server provider [6af6a902] #1297 #1309 +- Add support for AWS temporary security credentials #934 +- Fix Broken container environment when enabling metrics #1289 +- Improve resource not found error message [02cf0a55] +- Remove route operator #991 diff --git a/changelog/nextflow/v19.11.0-edge.mdx b/changelog/nextflow/v19.11.0-edge.mdx new file mode 100644 index 000000000..f495be87f --- /dev/null +++ b/changelog/nextflow/v19.11.0-edge.mdx @@ -0,0 +1,35 @@ +--- +title: Nextflow v19.11.0-edge +date: 2019-12-02 +tags: [nextflow] +--- + +- Fix Allow the output of process env variables #69 [1c1befc7] +- Fix docs rounding issue #1350 [af824fc7] +- Fix Join operation incorrectly represented in DAG #1346 [9d83ed51] +- Fix Tiny typo in docs #1361 +- Fix lost trace/report/timeline file name +- Fix invalid class exception [4308d6a4] +- Fix Invalid dynamic resolution of stageIn/OutMode directive #1374 +- Fix No such property stackTraceDepth error #1387 [49450f67] [f5342e71] +- Fix Singularity env variables are not accessible #1386 [036af4a6] +- Fix PublishDir should not create dir when disabled #1381 +- Fix Process hangs for non zero exit status #1344 +- Fix Output stdout does not support emit attribute #1373 +- Fix False positive warning when importing module #1349 +- Fix HTCondor queue status command #1353 [a1addc8f] +- Fix Escape file names with blanks #1392 +- Fix broken docs tutorial #1366 +- Patch Duration unit cannot be a negative number #1384 +- Handle ProviderMismatchException in CacheHelper (#1382) [cc584368] [3523f174] +- Introduce workflow take in place of get [DSL2] [e8cbbf08] +- Disable ansi log when using dockerized run [86bc2ada] +- Minor logging change [238b0e6c] [f5342e71] [b707882f] [ce97f073] +- Add multiMap in place of fork operator [afd671c8] +- Add Show Tower init response message as warning +- Add output path includeInputs docs [2ce7e861] +- Add metrics fields check #1360 [5b7f42e9] [caf9f137] [7332c606] +- Add console command to cli help #1347 +- Add OAR executor #1343 +- Add graphiviz to Docker image #1370 +- Removed unused property [9c65426a] diff --git a/changelog/nextflow/v19.12.0-edge.mdx b/changelog/nextflow/v19.12.0-edge.mdx new file mode 100644 index 000000000..0dc9c0d24 --- /dev/null +++ b/changelog/nextflow/v19.12.0-edge.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v19.12.0-edge +date: 2019-12-20 +tags: [nextflow] +--- + +- Add Google Life sciences (GLS) executor #1406 [ead29c11] [8228e9b4] +- Add GLS assigned zone discovery #1406 +- Add GLS bootDiskSize support #1331 [f118798c] [af8fe16d] +- Add GLS job debugging #1351 +- Fix NPE when file pattern is missing [1cbb6e49] +- Fix AWS cloud parsing for NVEe storage and tests +- Fix Disable ansi log on non-tty env #1417 +- Fix Allow Singularity image path with blank #1368 +- Fix Shell template invalid caching #1422 +- Fix Task vars ordering may invalidate cache #1408 +- Fix Join operator not matching gstrings #1394 +- Fix sigpipe error caused by runner script #1332 +- Fix Google Storage bucket with underscore is not recognized #1069 [85cd0cde] +- Fix fromFilePairs can't take list of paths #1405 [c00f5669] +- Refactor onFlowInit to onFlowCreate event [c477eeaf] +- Improve err msg when input files are remove from output [5d5744a8] +- Upgrade to Gradle 6.0.1 [e0c1a3ac] diff --git a/changelog/nextflow/v20.01.0-edge.mdx b/changelog/nextflow/v20.01.0-edge.mdx new file mode 100644 index 000000000..3d74d7ed8 --- /dev/null +++ b/changelog/nextflow/v20.01.0-edge.mdx @@ -0,0 +1,31 @@ +--- +title: Nextflow v20.01.0-edge +date: 2020-01-20 +tags: [nextflow] +--- + +- Add Prevent negative progress stats [87cdddc6] +- Add More cloud tests [7a5dd828] +- Add support for UGE throttled jobs (Tr) #1461 [20408e4b] +- Add progress stats to tower client [781116a4] [138cf0b0] +- Add experimental Podman containers support (#1451) 026866cd +- Add support for Gexf format for DAG rendering [28bfe0ee] +- Improve ansi logging for multilines output [1ce978c3] [004e23eb] +- Improve progress stats and ansi log [0212ba16] +- Improve api to enable wr executor #1148 [21088ad3] +- Update tower trace client requests [138cf0b0] +- Enhance progress execution stats & tracking [a30e2b9a] +- Unexpected output when using Google Storage as work dir #1452 +- Fix typos and minor changes [fb2f954f] +- Fix Operator splitFastq fails with PE option and DSL2 enabled #1390 +- Fix Container entrypoint when using GLS executor #1291 +- Fix GLS file unstaging #1406 [e67ef3be] +- Fix GLS unstage for file patterns #1406 +- Fix Scratch directive does not work #1280 [644e9ac7] [6c7291fa] +- Fix Resume fails due to LevelDB exception #1358 [28fa3a6c] +- Fix Conda env activation #1195 [e3919275] +- Fix java command in launch script #1436 [f28b015f] +- Rename variable java to JAVA_BIN [086377d8] +- Removed unused compile deps [686bcd98] +- Bump capsule-maven 1.0.3.2 and fix broken env [004684e3] +- Bump capsule-maven 1.0.3.1 and seqera repo [62964eed] diff --git a/changelog/nextflow/v20.01.0.mdx b/changelog/nextflow/v20.01.0.mdx new file mode 100644 index 000000000..69b7e81a9 --- /dev/null +++ b/changelog/nextflow/v20.01.0.mdx @@ -0,0 +1,110 @@ +--- +title: Nextflow v20.01.0 +date: 2020-02-12 +tags: [nextflow] +--- + +- Fix ansi logging and line count [4f5c7187] +- Fix Division by 0 in launcher script with Biocontainers #1488 +- Fix Run name validation to 80 chars max #1491 +- Add GitHub badge to README +- Add Bash version to issue template [78928546] +- Bump jline 2.14.9 [5df2b27e] + +(included with 20.01.0-rc1) +- Add ability to extend module params #1484 [17c6acca] +- Add dsl2 command line opt [1cf544d5] +- Add GLS executor docs [574f2098] [7ce2597a] +- Add HTCondor detail on data sharing #1473 [f0af66de] +- Allow aliased process to inherit config settings [DSL2] [1c447e85] +- Allow module inclusion to inherit context params #1484 +- Allow multiple inclusion from the same module [DSL2] [a9ae36f9] +- Fix Script template fails to render list of files #1478 [2e97bbbc] +- Fix process name validation when using legacy script [1543365c] +- Fix Early detection Dsl2 declaration #1468 [93a642aa] +- Fix Missing script validation checks #1468 [5d0cf145] +- Revert "Disable ansi log on non-tty env #1417" [98e6758b] +- Minor changes gradle build [619385f1] +- Minor AWS Batch api refactor [c20abc11] +- Improve foreign file detection [50508684] +- Improve GLS location validation [5b89ab50] +- Removed unused module flag [cf19cc9c] +- Update dsl2 docs [5c57c3a8] + +(included with 20.01.0-edge ) +- Add Prevent negative progress stats [87cdddc6] +- Add More cloud tests [7a5dd828] +- Add support for UGE throttled jobs (Tr) #1461 [20408e4b] +- Add progress stats to tower client [781116a4] [138cf0b0] +- Add experimental Podman containers support (#1451) 026866cd +- Add support for Gexf format for DAG rendering [28bfe0ee] +- Improve ansi logging for multilines output [1ce978c3] [004e23eb] +- Improve progress stats and ansi log [0212ba16] +- Improve api to enable wr executor #1148 [21088ad3] +- Update tower trace client requests [138cf0b0] +- Enhance progress execution stats & tracking [a30e2b9a] +- Unexpected output when using Google Storage as work dir #1452 +- Fix typos and minor changes [fb2f954f] +- Fix Operator splitFastq fails with PE option and DSL2 enabled #1390 +- Fix Container entrypoint when using GLS executor #1291 +- Fix GLS file unstaging #1406 [e67ef3be] +- Fix GLS unstage for file patterns #1406 +- Fix Scratch directive does not work #1280 [644e9ac7] [6c7291fa] +- Fix Resume fails due to LevelDB exception #1358 [28fa3a6c] +- Fix Conda env activation #1195 [e3919275] +- Fix java command in launch script #1436 [f28b015f] +- Rename variable java to JAVA_BIN [086377d8] +- Removed unused compile deps [686bcd98] +- Bump capsule-maven 1.0.3.2 and fix broken env [004684e3] +- Bump capsule-maven 1.0.3.1 and seqera repo [62964eed] + +(included with 19.12.0-edge) +- Add GLS assigned zone discovery #1406 +- Add Google Life sciences (GLS) executor improvements #1406 [ead29c11] [8228e9b4] +- Add GLS bootDiskSize support #1331 [f118798c] [af8fe16d] +- Add GLS job debugging #1351 +- Fix NPE when file pattern is missing [1cbb6e49] +- Fix AWS cloud parsing for NVEe storage and tests +- Fix Disable ansi log on non-tty env #1417 +- Fix Allow Singularity image path with blank #1368 +- Fix Shell template invalid caching #1422 +- Fix Task vars ordering may invalidate cache #1408 +- Fix Join operator not matching gstrings #1394 +- Fix sigpipe error caused by runner script #1332 +- Fix Google Storage bucket with underscore is not recognized #1069 [85cd0cde] +- Fix fromFilePairs can't take list of paths #1405 [c00f5669] +- Refactor onFlowInit to onFlowCreate event [c477eeaf] +- Improve err msg when input files are remove from output [5d5744a8] +- Upgrade to Gradle 6.0.1 [e0c1a3ac] + +(included with 19.11.0-edge) +- Increase tasks.module to 255 [7332c606] +- Fix Allow the output of process env variables #69 [1c1befc7] +- Fix docs rounding issue #1350 [af824fc7] +- Fix Join operation incorrectly represented in DAG #1346 [9d83ed51] +- Fix Tiny typo in docs #1361 +- Fix lost trace/report/timeline file name +- Fix invalid class exception [4308d6a4] +- Fix Invalid dynamic resolution of stageIn/OutMode directive #1374 +- Fix No such property stackTraceDepth error #1387 [49450f67] [f5342e71] +- Fix Singularity env variables are not accessible #1386 [036af4a6] +- Fix PublishDir should not create dir when disabled #1381 +- Fix Process hangs for non zero exit status #1344 +- Fix Output stdout does not support emit attribute #1373 +- Fix False positive warning when importing module #1349 +- Fix HTCondor queue status command #1353 [a1addc8f] +- Fix Escape file names with blanks #1392 +- Fix broken docs tutorial #1366 +- Patch Duration unit cannot be a negative number #1384 +- Handle ProviderMismatchException in CacheHelper (#1382) [cc584368] [3523f174] +- Introduce workflow take in place of get [DSL2] [e8cbbf08] +- Disable ansi log when using dockerized run [86bc2ada] +- Minor logging change [238b0e6c] [f5342e71] [b707882f] [ce97f073] +- Add multiMap in place of fork operator [afd671c8] +- Add Show Tower init response message as warning +- Add output path includeInputs docs [2ce7e861] +- Add metrics fields check #1360 [5b7f42e9] [caf9f137] +- Add console command to cli help #1347 +- Add OAR executor #1343 +- Add graphiviz to Docker image #1370 +- Removed unused property [9c65426a] diff --git a/changelog/nextflow/v20.02.0-edge.mdx b/changelog/nextflow/v20.02.0-edge.mdx new file mode 100644 index 000000000..594cd22c3 --- /dev/null +++ b/changelog/nextflow/v20.02.0-edge.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v20.02.0-edge +date: 2020-02-29 +tags: [nextflow] +--- + +- Fix Unable to create AWS helper class warn #1504 +- Fix Ansi log flickers when variable-length tags are used #1288 +- Fix Directive maxForks may cause execution to hang #1432 +- Fix Missing tag in ANSI log #1503 +- Fix PBSPRO res req should always include cpus #1510 +- Deprecate workflow publish 7f315a63 diff --git a/changelog/nextflow/v20.03.0-edge.mdx b/changelog/nextflow/v20.03.0-edge.mdx new file mode 100644 index 000000000..664a35e7d --- /dev/null +++ b/changelog/nextflow/v20.03.0-edge.mdx @@ -0,0 +1,17 @@ +--- +title: Nextflow v20.03.0-edge +date: 2020-03-28 +tags: [nextflow] +--- + +- Add support for GLS private addr #1545 [a481b42b] +- Add AWS batch job def normalise function [79239f05] +- Fix Escape Singularity env variables #1535 [b651a371] +- Add Local executor file system check [ffc92926] +- Add Launch Id to Tower client [d768d2d1] +- Add workflow progress on completion [aea41f37] +- Remove deprecated onFlowStart method [14f12b5f] +- Minor method visibility change [43bc9697] +- Minor log change [130a963b] +- Fix docs broken link [0a1ec9a9] +- Fix typo CVS -> CSV #1500 [d89281c3] diff --git a/changelog/nextflow/v20.04.0-edge.mdx b/changelog/nextflow/v20.04.0-edge.mdx new file mode 100644 index 000000000..4ad9a9ca4 --- /dev/null +++ b/changelog/nextflow/v20.04.0-edge.mdx @@ -0,0 +1,33 @@ +--- +title: Nextflow v20.04.0-edge +date: 2020-04-13 +tags: [nextflow] +--- + +- Add SGE hr status handling (#1558) [f4db0049] +- Add moduleDir, projectDir and launchDir vars [7832a697] [576a5694] +- Add executor display name rendering [74c90ca9] +- Add ability to pipe custom fun [DSL2] [80bb6485] +- Add Aws Batch container image validation [e73951fa] +- Recognizes more UGE states (#1536) [4dacebbf] +- Prevent invalid process tag values [f2da1357] +- Report Tower backend error cause on failure [da8ac8f5] +- Fix Config cmd should resolve remote projects #889 [c2e0ac0b] +- Fix issue applying branch/multiMap to value channel [e69f39fa] +- Fix Kill signal is not propagated for Singularity container #1561 +- Fix docs typos [d7261d2e] +- Fix Minor docs update #1545 +- Revert "Bump jline 2.14.9" [ef7040cb] +- Deprecate validExitStatus directive #1564 +- Improve error message [DSL2] [f8a0ee1c] +- Add sluper parse method for Path [a54fd03d] +- Report error message when accessing invalid out #1553 [83bd009c] +- Remove deprecated $ config syntax [0a31f9df] +- Remove deprecated workflow publish [DSL2] [1bd7b4a4] +- Remove support for workflow 'get' [d9b91149] +- Remove deprecated process output getter [013a323b] +- Remove deprecated out cardinal getters [414fae94] +- Remove deprecated gpu directive [f48b2c24] +- Minor executor logging [7f94299b] +- Minor improvement createDirIfNotExists API [34211675] +- Bump groovy 2.5.11 diff --git a/changelog/nextflow/v20.04.1-edge.mdx b/changelog/nextflow/v20.04.1-edge.mdx new file mode 100644 index 000000000..97a498dd6 --- /dev/null +++ b/changelog/nextflow/v20.04.1-edge.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v20.04.1-edge +date: 2020-04-19 +tags: [nextflow] +--- + +- Fix AWS auth with temporary security token [6a7b11b8] diff --git a/changelog/nextflow/v20.04.1.mdx b/changelog/nextflow/v20.04.1.mdx new file mode 100644 index 000000000..61c2b247e --- /dev/null +++ b/changelog/nextflow/v20.04.1.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v20.04.1 +date: 2020-05-03 +tags: [nextflow] +--- + +- Add executor display name rendering [41e12a86] +- Add Aws Batch container image validation[e73951fa] +- Add SGE hr status handling (#1558) [f4db0049] +- Add Recognition for more UGE states (#1536) [4dacebbf] +- Fix Prevent invalid process tag values [f2da1357] +- Fix issue applying branch/multiMap to value channel [691963db] +- Fix AWS auth with temporary security token [e445b5eb] +- Fix Report Tower backend error cause on failure [da8ac8f5] +- Fix Config cmd should resolve remote projects #889 [62d54ac6] +- Fix for accelerator docs (#1578) e13f632d +- Update cloud docs [509d9966] +- Revert "Bump jline 2.14.9" [4078b860] +- Add docs tip [a215947d] +- Plus changes from [20.03.0-edge](https://github.com/nextflow-io/nextflow/releases/tag/v20.03.0-edge) and [20.02.0-edge](https://github.com/nextflow-io/nextflow/releases/tag/v20.02.0-edge) diff --git a/changelog/nextflow/v20.05.0-edge.mdx b/changelog/nextflow/v20.05.0-edge.mdx new file mode 100644 index 000000000..51e542084 --- /dev/null +++ b/changelog/nextflow/v20.05.0-edge.mdx @@ -0,0 +1,18 @@ +--- +title: Nextflow v20.05.0-edge +date: 2020-05-31 +tags: [nextflow] +--- + +- Add support for NXF_LOG_NAME env var [cf496615] +- Add exception specialiation for ambiguous repo [a34b1d2a] +- Add support for tower_workflow_id env var [53188126] +- Add config profile names accessor [2784cdb8] +- Add support for Google Cloud buckets with Requester Pays set #1466 [bc9db8d8] +- Add Git tag and branch retrieval [7c97f23f] +- Fix PublishDir error caused by duplicates output files [5f3b69c1] +- Fix weird issue on config resolution [0d0fef4b] +- Fix resolution of malformed configs [fe213e41] +- Fix K8s labels and annotation normalization [6434b9d] #1577 #1584 +- Fix minor git path provider ending slash [9888be29] +- Fix bugs in GA4GH TES support (#1589) [26708335] diff --git a/changelog/nextflow/v20.06.0-edge.mdx b/changelog/nextflow/v20.06.0-edge.mdx new file mode 100644 index 000000000..1062532df --- /dev/null +++ b/changelog/nextflow/v20.06.0-edge.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v20.06.0-edge +date: 2020-07-05 +tags: [nextflow] +--- + +- Add more debug logging for AWS helper [2a62fdf7] +- Add join options failOnDuplicate and failOnMismatch [387366aa] +- Add strict mode flag [4ba5ac18] +- Add support for selecting minimum CPU platform on GCP #1632 (#1633) [afc4375d] +- Add missing trace fields to docs [bf2e1637] +- Fix Invalid GLS path composition in staging directories #1654 [e33fff98] +- Fix for feature 1647 that allows non gpu k8s accelerator resources. (#1649) [c1efa29d] +- Fix Issue accessing S3 bucket #1596 [ffc6f843] +- Fix Update getDomain method in ProviderConfig to support local repositories - #1492 (#1624) [651501ac] diff --git a/changelog/nextflow/v20.07.1.mdx b/changelog/nextflow/v20.07.1.mdx new file mode 100644 index 000000000..d4c086184 --- /dev/null +++ b/changelog/nextflow/v20.07.1.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v20.07.1 +date: 2020-07-24 +tags: [nextflow] +--- + +- Add Dsl2 enable flag [08238109] +- Add check on invalid scope syntax definition [23c92021] +- Add channel as alias for Channel [05c358c9] +- Add DSL2 deprecation + clean up syntax [1b4b1307] +- Add DOI field to NF manifest #1676 [ec6ee223] +- Improve join duplicate detection [33eb9ef5] +- Improve mix operator error message [8074d714] +- Remove invalid log message [48b1b9f1] +- Fix hidden error message on fail fast run [3b4b377c] +- Disallow upwrapped includes + hard deprecation [19130f87] +- Suppress trap for SIGUSR1 signal #1656 [ca5bcf46] +- Improve error reporting on invalid task id [3921de1a] +- Allow unqualified stdin/stdout defintions with DLS2 [bcdcaab6] diff --git a/changelog/nextflow/v20.08.0-edge.mdx b/changelog/nextflow/v20.08.0-edge.mdx new file mode 100644 index 000000000..681d19daf --- /dev/null +++ b/changelog/nextflow/v20.08.0-edge.mdx @@ -0,0 +1,24 @@ +--- +title: Nextflow v20.08.0-edge +date: 2020-08-25 +tags: [nextflow] +--- + +- Merge Groovy3 runtime and support for Java 12/13/14 +- Use repository URL instead of Git clone URL [102f8b01] +- Fix Invalid exception capture for missing config [8c7accca] +- Fix podman issue on duplicate mounts #1710 [d0cc38de] +- Fix FromSra illegal character error #1700 [a45decfb] +- Fix Allow custom SCM file location #1657 [7c27f895] +- Fix dynamic executors loading [7b9ce82f] +- Fix missing newline on cmd log stdout/err #1705 [1416a388] +- Fix k8s timeline start #1687 [24dff871] +- Remove unneeded parentheses from stdout declaration [dc029c04] +- Merge execution logs command docs [577ec744] +- Passing exact memory to TES executor in GiB #1696 [c8a15545] +- Improve docs replacing suscribe{println it} with view() [f84ccb6f] [cb2d607d] +- Use current environment Bash #1598 #1614 [e70ef87a] +- Include GA4GH support into the standalone binary (make pack) #1666 [e2175d45] +- Update Bitbucket docs [b9b57f83] +- Clone/Pull submodules recursively #1615 [5f20ab6a] +- Bump nf-ignite to version 1.1.0 diff --git a/changelog/nextflow/v20.08.1-edge.mdx b/changelog/nextflow/v20.08.1-edge.mdx new file mode 100644 index 000000000..68842b44a --- /dev/null +++ b/changelog/nextflow/v20.08.1-edge.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v20.08.1-edge +date: 2020-09-02 +tags: [nextflow] +--- + +Add variable NXF_CONFIG_FILE [d15edcb8] diff --git a/changelog/nextflow/v20.09.0-edge.mdx b/changelog/nextflow/v20.09.0-edge.mdx new file mode 100644 index 000000000..293b92973 --- /dev/null +++ b/changelog/nextflow/v20.09.0-edge.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v20.09.0-edge +date: 2020-09-23 +tags: [nextflow] +--- + +- Fix invalid error message on missing process #1719 [fc607f11] +- Deduplicate GS file + parallel up/downloads [29d37083] +- Deduplicate S3 file uploads [0b65d61f] +- Fix issue on GS path composition [276f0ed3] +- Add NXF_PARAMS_FILE env var [2e3c9232] +- Allow configurable container mounts [8dc0adf4] +- Refactor common Bash helper functions [22a0ff34] [502309b7] +- Fix race condition creating FTP file system #1725 +- Fix invalid checkWarn method invocation [ba052a02] +- Move makeDigest into build.gradle file [a2b5de8f] +- Add variable NXF_CONFIG_FILE [83365aa3] +- Patch use of GString for fromSra apiKey option [a8b81ada] +- Use repository URL instead of Git clone URL [75a04d90] +- Fix Invalid exception capture for missing config [ce427924] +- Fix podman issue on duplicate mounts [661a40e9] +- Fix FromSra illegal character error [5a86d180] +- Fix Allow custom SCM file location #1657 [a90e66e3] diff --git a/changelog/nextflow/v20.09.1-edge.mdx b/changelog/nextflow/v20.09.1-edge.mdx new file mode 100644 index 000000000..f5afa7c68 --- /dev/null +++ b/changelog/nextflow/v20.09.1-edge.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v20.09.1-edge +date: 2020-10-15 +tags: [nextflow] +--- + +- Prevent USR1 signal to stop jobs #1753 +- Add -main-script cli option [702ff64c] +- Improve Singularity image file caching #1706 [dd92772b] +- Fix unexpected default GLS action flags #1749 +- Patch unpexpected error on tower serialization [f922324a] diff --git a/changelog/nextflow/v20.10.0.mdx b/changelog/nextflow/v20.10.0.mdx new file mode 100644 index 000000000..e4e42b11d --- /dev/null +++ b/changelog/nextflow/v20.10.0.mdx @@ -0,0 +1,56 @@ +--- +title: Nextflow v20.10.0 +date: 2020-11-01 +tags: [nextflow] +--- + +- Add warning for AWS Batch mem request lower than 4 MB [e9240fc9] +- Add support for Bitbucket tags and branches retrieval [5083066e] +- Add support for Tower client bearer authentication [532282ae] +- Add support for Java 15 [b1f48884] +- Fix issue with docker images tagged by SHA #1777 +- Fix Skip FS lock when Conda dir exist #1771 +- Fix build with Gradle 6.7 [8d7227f0] + +(from 20.09.1-edge) +- Prevent USR1 signal to stop jobs #1753 +- Add -main-script cli option [702ff64c] +- Improve Singularity image file caching #1706 [dd92772b] +- Fix unexpected default GLS action flags #1749 +- Patch unpexpected error on tower serialization [f922324a] + +(from 20.09.0-edge) +- Fix invalid error message on missing process #1719 [fc607f11] +- Deduplicate GS file + parallel up/downloads [29d37083] +- Deduplicate S3 file uploads [0b65d61f] +- Fix issue on GS path composition [276f0ed3] +- Add NXF_PARAMS_FILE env var [2e3c9232] +- Allow configurable container mounts [8dc0adf4] +- Refactor common Bash helper functions [22a0ff34] [502309b7] +- Fix race condition creating FTP file system #1725 +- Fix invalid checkWarn method invocation [ba052a02] +- Move makeDigest into build.gradle file [a2b5de8f] +- Patch use of GString for fromSra apiKey option [a8b81ada] + +(from 20.08.1-edge) +- Add variable NXF_CONFIG_FILE [d15edcb8] + +(from 20.08.0-edge) +- Merge Groovy3 runtime and support for Java 12/13/14 +- Use repository URL instead of Git clone URL [102f8b01] +- Fix Invalid exception capture for missing config [8c7accca] +- Fix podman issue on duplicate mounts #1710 [d0cc38de] +- Fix FromSra illegal character error #1700 [a45decfb] +- Fix Allow custom SCM file location #1657 [7c27f895] +- Fix dynamic executors loading [7b9ce82f] +- Fix missing newline on cmd log stdout/err #1705 [1416a388] +- Fix k8s timeline start #1687 [24dff871] +- Remove unneeded parentheses from stdout declaration [dc029c04] +- Merge execution logs command docs [577ec744] +- Passing exact memory to TES executor in GiB #1696 [c8a15545] +- Improve docs replacing suscribe{println it} with view() [f84ccb6f] [cb2d607d] +- Use current environment Bash #1598 #1614 [e70ef87a] +- Include GA4GH support into the standalone binary (make pack) #1666 [e2175d45] +- Update Bitbucket docs [b9b57f83] +- Clone/Pull submodules recursively #1615 [5f20ab6a] +- Bump nf-ignite to version 1.1.0 diff --git a/changelog/nextflow/v20.11.0-edge.mdx b/changelog/nextflow/v20.11.0-edge.mdx new file mode 100644 index 000000000..aeed55496 --- /dev/null +++ b/changelog/nextflow/v20.11.0-edge.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v20.11.0-edge +date: 2020-11-16 +tags: [nextflow] +--- + +- Fix Allow nextflow to handle http protocol for Singularity images #1791 +- Fix params-file overrides config parameters [b03efcac] +- Fix println failing test #1621 [8c6f0f97] [9d2e5850] +- Let output env variables be optional (#1740) [3fca3655] +- Add stub-run feature #1774 [3de45c22] [e2d6d55b] +- Add overwrite option to trace/time/report/dag features #813 [a0615474] +- Allow nested CLI params #1182 [19ab8a8f] [df6204e3] +- Allow setting google projectId in nextflow config [223b5d6c] +- Make binDir accessible from the executor scope [1405a28f] diff --git a/changelog/nextflow/v20.12.0-edge.mdx b/changelog/nextflow/v20.12.0-edge.mdx new file mode 100644 index 000000000..6ee21948c --- /dev/null +++ b/changelog/nextflow/v20.12.0-edge.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v20.12.0-edge +date: 2020-12-12 +tags: [nextflow] +--- + +- Add support for charliecloud container engine #1809 +- Fix glitch on K8s task progress update [668434f6] +- Upgrade to groovy 3.0.7 [27056035] diff --git a/changelog/nextflow/v21.01.0-edge.mdx b/changelog/nextflow/v21.01.0-edge.mdx new file mode 100644 index 000000000..239805511 --- /dev/null +++ b/changelog/nextflow/v21.01.0-edge.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v21.01.0-edge +date: 2021-01-04 +tags: [nextflow] +--- + +- Merge plugins feature [d959bfdb] +- Prevent twice access remote scm file [b2798556] +- Fix DAG edges not connected correctly #1486 [cece1161] +- Fix k8s executor must provide cpu resource requests #1570 [6896e923] +- Fix http/ftp read buffer size [a2886baf] +- Add support for OAuth Bearer auth [5823c280] +- Add support for basic auth for http/s file provider [6027fcba] +- Add User-Agent info to httpfs requests [222637de] +- Update CPU and RAM for containers (#1833) [ccf5c8ba] +- Move test containes to quay.io [7db053eb] [773be707] [c10a7f53] diff --git a/changelog/nextflow/v21.01.1-edge.mdx b/changelog/nextflow/v21.01.1-edge.mdx new file mode 100644 index 000000000..be6ddf3ca --- /dev/null +++ b/changelog/nextflow/v21.01.1-edge.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v21.01.1-edge +date: 2021-01-15 +tags: [nextflow] +--- + +- Plugins stability improvements [8d849ec9] [bf093826] +- Charliecloud improvements [2242411a] +- Fix issue of FS discovery with dyn plugin loading [bf5e86df] +- Fix crash on startup when mem reported < 0 [095236b8] +- Fix and stability [e4b8afb5] +- Fix launcher on Java11 [c6b78034] +- Add plugins custom version manager (4 days ago) +- Improve NF version checking [d33ea642] +- Bump plugins minor upgrade [f91bc21e] diff --git a/changelog/nextflow/v21.02.0-edge.mdx b/changelog/nextflow/v21.02.0-edge.mdx new file mode 100644 index 000000000..aac91139c --- /dev/null +++ b/changelog/nextflow/v21.02.0-edge.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v21.02.0-edge +date: 2021-02-01 +tags: [nextflow] +--- + +- Fix Issue when merging nested cli params #1856 [275e54c4] [fe37da6d] +- Fix job status detection on PBS pro #1840 [c1598908] +- Fix Issue when merging nested cli params #1856 (19 hours ago) +- Revert the CPU/memory options being passed to singularity VM instead of singularity container [0d04e0f9] +- Add ability to specify plugins with cli [de91218f] +- Decrease upload/download process polling to 0.2secs [6ca2d6ca] +- Remove nf-amazon as default [e6810e90] +- Make plugin services singleton [cacd9328] [5787be6d] +- Make repository provider accessible to subclasses [988bccc6] +- Fix error on plugin downloading #1859 [77cabb3c] diff --git a/changelog/nextflow/v21.03.0-edge.mdx b/changelog/nextflow/v21.03.0-edge.mdx new file mode 100644 index 000000000..0604c4f94 --- /dev/null +++ b/changelog/nextflow/v21.03.0-edge.mdx @@ -0,0 +1,27 @@ +--- +title: Nextflow v21.03.0-edge +date: 2021-03-05 +tags: [nextflow] +--- + +- Add support for serializable ValueObject [8dfaadf3] +- Add abilitity to fetch revisioned git assets +- Add support for FixOwnership to AWS batch [24f83741] +- Add support for custom network to GLS #1810 [171f4aa8] +- Add ability to handle list of az vm types [00ced0b3] +- Add tower config scope to docs #1890 f2bd96fa +- Add charliecloud container environment from file (#1909) 4553648b +- Add azcopy tool install mode opts [9e9337d3] +- Update Az default vm type to Standard_D4_v3 [4c6e76b6] +- Update NF console dependency [a2d06e15] +- Remove CDN from timeline reports and make them offline readable #1927 [c0e5a941] +- Fix plugins install failing in some file systems #1882 [8cc43391] +- Fix catch failing commands in nxf_parallel #1884 [dd56f6c1] +- Fix missing error on empty process script [3607f84e] +- Fix GSL path de-serialization issue [c6cf784f] +- Fix Memory unit cannot be a negative number #1902 [abd1c9d9] +- Fix pod spec labels to start with numbers in addition to alphas [79740edf] +- Fix OAR executor log files #1761 [6f2ff4e4] +- Fix issue cause by sleep with subsecond argument [c4be8d00] [63974ac6] +- Fix az blob storage SAS permissions [18a33213] +- Fix sort human-readable tasks in report [6d68f28d] diff --git a/changelog/nextflow/v21.04.0-edge.mdx b/changelog/nextflow/v21.04.0-edge.mdx new file mode 100644 index 000000000..49a57ab40 --- /dev/null +++ b/changelog/nextflow/v21.04.0-edge.mdx @@ -0,0 +1,29 @@ +--- +title: Nextflow v21.04.0-edge +date: 2021-04-08 +tags: [nextflow] +--- + +- Add readOnly flag to k8s volume mounts (#2013) [33bd24ac] +- Add Start default plugins on-demand #1964 [cf2a9d73] +- Add support for tower workspaceId [e2977688] +- Improve suppor for BitBucket server repos [eb946e27] +- Fix toInt/Long/Float/Double operator hangs with value channel [7c35d985] +- Fix regression caused by nested params handling #1923 [b25af49b] +- Fix Cache invalidation when repo is cloned between runs #1989 [ac526f38] +- Fix Invalid setting of TMP var with singularity #1997 [23f80121] [472cfbdd] +- Fix issue overriding nested params from cli #1923 [cfe6b1d1] +- Fix az path handling curly brackets globs #1969 [c78a1bbf] +- Fix Missing git credentials when checking last commit id [f101308e] +- Fix plugins version check against local installation [535c2bb5] +- Fix local dependant formatting #1962 [2a5cbac1] +- Fix Encode path parameter at GitLab getContentUrl [6f80f651] +- Fix Only use sudo rm with docker #1956 [f9490423] +- Prevent AZ NPE when missing vmtype + better logging #1992 [711362ca] +- Refactor params file var binding #1860 #1972 [330f044a] +- Prevent jobs names longer than 100 chars OAR exec [6daa21b9] +- Bump nf-azure@0.9.6 + nf-amazon@1.0.3 [aff1d355] +- Bump nf-amazon@1.0.3 - s3fs@1.0.9 - solve #1830 [b3b221c1] +- Bump nf-tower@1.1.0 [29fdd9f7] +- Bump nf-amazon@1.0.4 + nxf-s3fs@1.1.0 [c638af80] +- Bump nf-azure@0.9.7 [07c59946] diff --git a/changelog/nextflow/v21.04.0.mdx b/changelog/nextflow/v21.04.0.mdx new file mode 100644 index 000000000..da99176dd --- /dev/null +++ b/changelog/nextflow/v21.04.0.mdx @@ -0,0 +1,115 @@ +--- +title: Nextflow v21.04.0 +date: 2021-05-02 +tags: [nextflow] +--- + +- Fix NPE when AWS Batch job container is not returned [412b6fde] +- Fix execution hang when native task fail to submit #2060 [1253485d] +- Update preview message [e1eebdcd] +- Fix nf-ignite all packaging [72b6a428] +- Fix GS failing tests [be4f91e9] +- Fix AWS batch executor fails when using self-contained distribution #2058 [2e344c18] +- Fix groupTuple sort criteria with closure #2020 [28a579a9] +- Patch invalid double number cli parsing #2039 [4de4670c] [dcadaaeb] +- Update sphinx_rtd_theme 0.5.2 [4a165f43] +- Disable cpus option when running docker with legacy opt [1a7854a5] + +21.04.0-edge - 8 Apr 2021 +- Add readOnly flag to k8s volume mounts (#2013) [33bd24ac] +- Add Start default plugins on-demand #1964 [cf2a9d73] +- Add support for tower workspaceId [e2977688] +- Improve suppor for BitBucket server repos [eb946e27] +- Fix toInt/Long/Float/Double operator hangs with value channel [7c35d985] +- Fix regression caused by nested params handling #1923 [b25af49b] +- Fix Cache invalidation when repo is cloned between runs #1989 [ac526f38] +- Fix Invalid setting of TMP var with singularity #1997 [23f80121] [472cfbdd] +- Fix issue overriding nested params from cli #1923 [cfe6b1d1] +- Fix az path handling curly brackets globs #1969 [c78a1bbf] +- Fix Missing git credentials when checking last commit id [f101308e] +- Fix plugins version check against local installation [535c2bb5] +- Fix local dependant formatting #1962 [2a5cbac1] +- Fix Encode path parameter at GitLab getContentUrl [6f80f651] +- Fix Only use sudo rm with docker #1956 [f9490423] +- Prevent AZ NPE when missing vmtype + better logging #1992 [711362ca] +- Refactor params file var binding #1860 #1972 [330f044a] +- Prevent jobs names longer than 100 chars OAR exec [6daa21b9] +- Bump nf-azure@0.9.6 + nf-amazon@1.0.3 [aff1d355] +- Bump nf-amazon@1.0.3 - s3fs@1.0.9 - solve #1830 [b3b221c1] +- Bump nf-tower@1.1.0 [29fdd9f7] +- Bump nf-amazon@1.0.4 + nxf-s3fs@1.1.0 [c638af80] +- Bump nf-azure@0.9.7 [07c59946] + +21.03.0-edge - 5 Mar 2021 +- Add support for serializable ValueObject [8dfaadf3] +- Add abilitity to fetch revisioned git assets +- Add support for FixOwnership to AWS batch [24f83741] +- Add support for custom network to GLS #1810 [171f4aa8] +- Add ability to handle list of az vm types [00ced0b3] +- Add tower config scope to docs #1890 f2bd96fa +- Add charliecloud container environment from file (#1909) 4553648b +- Add azcopy tool install mode opts [9e9337d3] +- Update Az default vm type to Standard_D4_v3 [4c6e76b6] +- Update NF console dependency [a2d06e15] +- Remove CDN from timeline reports and make them offline readable #1927 [c0e5a941] +- Fix plugins install failing in some file systems #1882 [8cc43391] +- Fix catch failing commands in nxf_parallel #1884 [dd56f6c1] +- Fix missing error on empty process script [3607f84e] +- Fix GSL path de-serialization issue [c6cf784f] +- Fix Memory unit cannot be a negative number #1902 [abd1c9d9] +- Fix pod spec labels to start with numbers in addition to alphas [79740edf] +- Fix OAR executor log files #1761 [6f2ff4e4] +- Fix issue cause by sleep with subsecond argument [c4be8d00] [63974ac6] +- Fix az blob storage SAS permissions [18a33213] +- Fix sort human-readable tasks in report [6d68f28d] + +21.02.0-edge - 1 Feb 2021 +- Fix Issue when merging nested cli params #1856 [275e54c4] [fe37da6d] +- Fix job status detection on PBS pro #1840 [c1598908] +- Fix Issue when merging nested cli params #1856 (19 hours ago) +- Revert the CPU/memory options being passed to singularity VM instead of singularity container [0d04e0f9] +- Add ability to specify plugins with cli [de91218f] +- Decrease upload/download process polling to 0.2secs [6ca2d6ca] +- Remove nf-amazon as default [e6810e90] +- Make plugin services singleton [cacd9328] [5787be6d] +- Make repository provider accessible to subclasses [988bccc6] +- Fix error on plugin downloading #1859 [77cabb3c] + +21.01.1-edge - 15 Jan 2021 +- Plugins stability improvements [8d849ec9] [bf093826] +- Charliecloud improvements [2242411a] +- Fix issue of FS discovery with dyn plugin loading [bf5e86df] +- Fix crash on startup when mem reported < 0 [095236b8] +- Fix and stability [e4b8afb5] +- Fix launcher on Java11 [c6b78034] +- Add plugins custom version manager (4 days ago) +- Improve NF version checking [d33ea642] +- Bump plugins minor upgrade [f91bc21e] + +21.01.0-edge - 04 Jan 2021 +- Merge plugins feature [d959bfdb] +- Prevent twice access remote scm file [b2798556] +- Fix DAG edges not connected correctly #1486 [cece1161] +- Fix k8s executor must provide cpu resource requests #1570 [6896e923] +- Fix http/ftp read buffer size [a2886baf] +- Add support for OAuth Bearer auth [5823c280] +- Add support for basic auth for http/s file provider [6027fcba] +- Add User-Agent info to httpfs requests [222637de] +- Update CPU and RAM for containers (#1833) [ccf5c8ba] +- Move test containes to quay.io [7db053eb] [773be707] [c10a7f53] + +20.12.0-edge - 12 Dec 2020 +- Add support for charliecloud container engine #1809 +- Fix glitch on K8s task progress update [668434f6] +- Upgrade to groovy 3.0.7 [27056035] + +20.11.0-edge - 16 Nov 2020 +- Fix Allow nextflow to handle http protocol for Singularity images #1791 +- Fix params-file overrides config parameters [b03efcac] +- Fix println failing test #1621 [8c6f0f97] [9d2e5850] +- Let output env variables be optional (#1740) [3fca3655] +- Add stub-run feature #1774 [3de45c22] [e2d6d55b] +- Add overwrite option to trace/time/report/dag features #813 [a0615474] +- Allow nested CLI params #1182 [19ab8a8f] [df6204e3] +- Allow setting google projectId in nextflow config [223b5d6c] +- Make binDir accessible from the executor scope [1405a28f] diff --git a/changelog/nextflow/v21.04.1.mdx b/changelog/nextflow/v21.04.1.mdx new file mode 100644 index 000000000..7b5b4fe3f --- /dev/null +++ b/changelog/nextflow/v21.04.1.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v21.04.1 +date: 2021-05-14 +tags: [nextflow] +--- + +- Fix nested params file parse #2091 +- Fix Malformed config error reporting #2105 +- Fix Use default opts for trace file creation [09e6c6ac] diff --git a/changelog/nextflow/v21.04.2.mdx b/changelog/nextflow/v21.04.2.mdx new file mode 100644 index 000000000..9cfffeb23 --- /dev/null +++ b/changelog/nextflow/v21.04.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v21.04.2 +date: 2021-07-12 +tags: [nextflow] +--- + +- Fix Plugin install lock file is not deleted #2103 [29c3e516c] +- Fix Default plugin version lookup [d340a221f] +- Fix BatchCleanup toString method [3c67fa3ae] +- Implicit variable projectDir breaks caching #2186 [7a4d1f1a2] diff --git a/changelog/nextflow/v21.04.3.mdx b/changelog/nextflow/v21.04.3.mdx new file mode 100644 index 000000000..ffd9890f0 --- /dev/null +++ b/changelog/nextflow/v21.04.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v21.04.3 +date: 2021-07-21 +tags: [nextflow] +--- + +- Fix Tower client is not activated launching all packaging diff --git a/changelog/nextflow/v21.05.0-edge.mdx b/changelog/nextflow/v21.05.0-edge.mdx new file mode 100644 index 000000000..acc63ee71 --- /dev/null +++ b/changelog/nextflow/v21.05.0-edge.mdx @@ -0,0 +1,22 @@ +--- +title: Nextflow v21.05.0-edge +date: 2021-05-28 +tags: [nextflow] +--- + +- Add support for using mamba with conda (#2030) [10c8385b] +- Add AWS cli native error fail-over [fd7670ef] +- Add support for Container Registry to Az Batch executor (#2078) [12bf2da6] +- Add support for Tower workspace (#2097) [8a4dd3ab] +- Add support custom service account email in Google Cloud LifeSciences executor (#2044) [a642c9ea] +- Add support for Java 16 + Gradle 7 [caace1c5] [e2dd4510] [74e466e0] [1245ab1c] [bfc69fb6] +- Improve tower client error reporting [4efb6bf6] +- Fix Plugin install lock file is not deleted #2103 [b7fdffac] +- Fix Use caller runs policy of default thread pool #2021 [48b4e8ee] +- Fix Error reporting for malformed config [68e5ca18] +- Decrease max par transfers to 4 [c7ea816a] +- Prevent fetching aws instance type when missing container id [f5f96049] +- Use default opts for trace file creation [d8ae94bf] +- Improve Azure Batch executor error code and messages for failed Tasks (#2099) [1d5fa5d5] +- Bump groovy 3.0.8 [aa695e12] +- Bump snakeyaml@1.28 [8d361954] diff --git a/changelog/nextflow/v21.06.0-edge.mdx b/changelog/nextflow/v21.06.0-edge.mdx new file mode 100644 index 000000000..9f68a19d6 --- /dev/null +++ b/changelog/nextflow/v21.06.0-edge.mdx @@ -0,0 +1,33 @@ +--- +title: Nextflow v21.06.0-edge +date: 2021-07-03 +tags: [nextflow] +--- + +- Add Keep alive option to Google LS executor [994222074] +- Add support for FTP proxy and proxy servers authentication [8ec33b04d] +- Add support for plugins groupping [aa5bc7d34] +- Add More details about the reason why a AWS Batch job has failed #2146 [27a4e88b2] +- Add support for extensions priority [ae083f1aa] +- Add stubRun attribute to workflow metadata #2164 [86cfc66fd] +- Add Run tasks under user accounts in Azure Batch #2157 [1c9fc4a40] +- Refactor GLS executor [2c86b79a4] [97fc49c09] +- Refactor AWS batch job def creation [89ce364c9] [986894287] +- Fix Default plugin version lookup [e0c8151d9] +- Fix Negative labels do not work as expected #2155 [491191811] +- Fix PublishDir overwriting task output files [190aa4eaf] +- Fix directory deletion strategy [b96fcedc8] +- Fix Implicit variable projectDir breaks caching #2186 [76417d273] +- Fix Prevent empty download array [9492cde5d] +- Fix output unstage with glob pattern [2d4c3dfcf] +- Fix Connection-reset crashes the workflow [3ee4fd0eb] [1400ded6d] [61bbc240a] [175c66584] +- Fix Slurm does not send soft kill message #2163 [f0ccfc7e8] +- Fix storeDir directive does not work with S3 #2141 [2e95a6a76] +- Fix maven local publish [05cfb7cf7] +- Fix GLS transfer attempts opts [f7c705db5] +- Fix build exportClasspath task [88d27f0c8] +- Fix PbsPro clusterOptions directive priority #2036 [75e3f225e] +- Disallow include nested within a workflow block [7dbf64bea] +- Upgrade AWS SDK minor version #2167 [296afaa8f] +- Improve gsutil transfer throughput [2da120b91] +- Improve config error reporting [6aa102430] diff --git a/changelog/nextflow/v21.07.0-edge.mdx b/changelog/nextflow/v21.07.0-edge.mdx new file mode 100644 index 000000000..ec9a26176 --- /dev/null +++ b/changelog/nextflow/v21.07.0-edge.mdx @@ -0,0 +1,24 @@ +--- +title: Nextflow v21.07.0-edge +date: 2021-08-06 +tags: [nextflow] +--- + +- Add support for AWS_MAX_ATTEMPTS variable [3cc543589] +- Add app plugin to gradle build [007bc1cb4] +- Add self pid to tower client [d2e54ea22] +- Add support for head job operationId + log/out files [a7a76cf91] +- Add enable CA Issuers option to NF launcher [8f51dc787] +- Fix Clean cmd fails removing foreign files [8bf8ab720] +- Fix Prevent script var names conflicting with private names #2246 [82bbc180e] +- Fix ENA download URL #2239 [befbabbc8] +- Fix Tower client is not activated launching all packaging #2145 [c507518c2] +- Fix orphaned AWS Batch jobs after pipeline interruption #2169 [65e2a4d05] +- Fix Process error report on target exception #1896 [1bac3f17b] +- Fix Unexpected bool conversion on publishDir enable/overwrite attributes #2220 [651835d2d] +- Fix BatchCleanup toString method [ec9bb5648] +- Improve error reporting [49ac01dbb] +- Improve Unknown host error message [ad41d1e98] +- Improve AWS Batch task handler [eb1aff275] +- Use AWS cli standard retry mode by default [f2f1fdea4] +- Report warn on cache hashing failures [7bf93de06] [3b579c954] diff --git a/changelog/nextflow/v21.08.0-edge.mdx b/changelog/nextflow/v21.08.0-edge.mdx new file mode 100644 index 000000000..5da0bc67b --- /dev/null +++ b/changelog/nextflow/v21.08.0-edge.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v21.08.0-edge +date: 2021-08-30 +tags: [nextflow] +--- + +- Fix plugin updater version logging [d162eb8b4] +- Fix Nextflow launcher breaks when java path contains blanks #2265 [8097a2a90] +- Fix docker build [efb2f449b] +- Fix NPE in AnsiLogObserver #2283 [cffc683df] +- Fix run script when fixing ownership in aws batch #2262 +- Improve plugins auto start [283144474] +- Improve log error reporting [401863085] +- Improve handling of K8s node shutdown [67250c041] +- Update GitHub docs [4532b8e1e] +- Merge nf-sqldb 0.1.0 diff --git a/changelog/nextflow/v21.09.0-edge.mdx b/changelog/nextflow/v21.09.0-edge.mdx new file mode 100644 index 000000000..82174be85 --- /dev/null +++ b/changelog/nextflow/v21.09.0-edge.mdx @@ -0,0 +1,37 @@ +--- +title: Nextflow v21.09.0-edge +date: 2021-10-12 +tags: [nextflow] +--- + +- Add secrets manager (preview) [da2a5ff1a] [2d66f83ca] +- Add Built-in support for Azure File Shares #2285 [a4c3e0ad5] +- Add Azure pool node SKU selection #2360 [9afcac756] +- Add support for protocol option to fromSRA #2087 [371f858ab] +- Add retry on AWS Job definition not-found error [452cae5d8] +- Add ability to define templates library at module level #2332 [7e7d52573] +- Add missing information for pulling images from private registry in Azure Batch #2355 [040e190bd] +- Add $NXF_CLI_OPTS env variable [7d57acca5] +- Add NXF_CACHE_MODE env variable [1c345c497] +- Fix asset directory consistent hashing via sha256 checksum [4c5c0ef41] +- Fix issue invoking extension method with GString params [570e5299c] +- Fix Prevent pipeline stopping when K8s pod is evicted [f9db9cc77] +- Fix clean command for Google storage [dc9625eb9] +- Fix plugins detection in local repo [6441a3882] +- Fix S3 canned ACL documentation #2334 [69216e292] +- Fix docker image build with recent docker [2aad36897] [1e485b32b] +- Fix amazon plugin is not used when using bucketDir option [6a8c50ad4] +- Fix Plugin dependency requirement overrides core plugin #2303 [4d1762fb3] +- Fix Make K8s ImagePullBackOff and ErrImagePull recoverable #2302 [766ffde40] +- Improve cache resume strategy [0b0eae225] +- Improve GH action build compressing integration tests [ab9d747d4] +- Prevent NPE if session is not set [83bb46d94] +- Remove deprecated attribute [50d63b6fb] +- Find newest matching plugin #2303 [e6cf79ff3] +- Documents noproxy variable #2325 [bc769b1b4] +- Bump Groovy 3.0.9 [dee2d6c99] +- Bump nf-sqldb@0.2.0 +- Bump nf-amazon@1.2.1 +- Bump nf-azure@0.11.0 +- Bump nf-google@1.1.1 + diff --git a/changelog/nextflow/v21.09.1-edge.mdx b/changelog/nextflow/v21.09.1-edge.mdx new file mode 100644 index 000000000..45a2f2285 --- /dev/null +++ b/changelog/nextflow/v21.09.1-edge.mdx @@ -0,0 +1,22 @@ +--- +title: Nextflow v21.09.1-edge +date: 2021-10-28 +tags: [nextflow] +--- + +- Fix issue with config selectors and DSL2 [4d7d3e972] +- Fix issue evaluating dynamic errorStrategy with AWS Batch [8c6a5a6e2] [ce4d491b1] +- Fix verbose logging [92b113134] +- Fix docker image url [ed24a475d] +- Fix Temporary directories not deleted in on_exit #2406 [181bdf528] +- Fix implict authentication for resources served by Tower [e30310b4f] +- Fix No more of 255 channels can be defined into a workflow context #2417 [7f91ecb39] +- Add tip about escaping variables in env scope #2366 +- Add K8s env fieldPath option to pod directive #2363 +- Improve AWS Batch error report fetching CloudWatch logs [b9f9578f1] [e229700ef] +- Improve docs about IAM policies for AWS Batch #2391 +- Accommodate token in password field for Gitlab #2389 [ee32b7726] +- Report a warning when main workflow is not defined [83aec6e8b] +- Bump nf-amazon 1.3.0 +- Bump nf-tower@1.3.0 +- Bump nf-google@1.1.2 diff --git a/changelog/nextflow/v21.10.0.mdx b/changelog/nextflow/v21.10.0.mdx new file mode 100644 index 000000000..754634c71 --- /dev/null +++ b/changelog/nextflow/v21.10.0.mdx @@ -0,0 +1,147 @@ +--- +title: Nextflow v21.10.0 +date: 2021-11-11 +tags: [nextflow] +--- + +- Add support for Java 17 [cb207cd64] +- Allow override Bash wrapper template files [e6e25ed7c] +- Fix issue with plugins local root sync [1d974a4eb] +- Fix Nextflow does not recognised Failed pod (#2430) [9c80cdea0] +- Fix Error reporting on Bash launcher creation failure [63e01c324] +- Fix Channel.fromSRA error one some project ids #2156 [dbcbac139] +- Fix Task completion percentage #2440 +- Display no workflow warn if no main is defined [0f1295694] +- Invalidate task cache on directive change (EXPERIMENTAL) [62ded3421] +- Upgrade XmlParser used by SraExplorer [543b582b5] +- Use AWS Batch resources requirement for CPUs and memory [1cf2c379c] +- Bump Gradle 7.3 stable + GHA cache [4eaa4f25f] + +21.09.1-edge - 28 Oct 2021 +- Fix issue with config selectors and DSL2 [4d7d3e972] +- Fix issue evaluating dynamic errorStrategy with AWS Batch [8c6a5a6e2] [ce4d491b1] +- Fix verbose logging [92b113134] +- Fix docker image url [ed24a475d] +- Fix Temporary directories not deleted in on_exit #2406 [181bdf528] +- Fix implict authentication for resources served by Tower [e30310b4f] +- Fix No more of 255 channels can be defined into a workflow context #2417 [7f91ecb39] +- Add tip about escaping variables in env scope #2366 +- Add K8s env fieldPath option to pod directive #2363 +- Improve AWS Batch error report fetching CloudWatch logs [b9f9578f1] [e229700ef] +- Improve docs about IAM policies for AWS Batch #2391 +- Accommodate token in password field for Gitlab #2389 [ee32b7726] +- Report a warning when main workflow is not defined [83aec6e8b] +- Bump nf-amazon 1.3.0 +- Bump nf-tower@1.3.0 +- Bump nf-google@1.1.2 + +21.09.0-edge - 12 Oct 2021 +- Add secrets manager (preview) [da2a5ff1a] [2d66f83ca] +- Add Built-in support for Azure File Shares #2285 [a4c3e0ad5] +- Add Azure pool node SKU selection #2360 [9afcac756] +- Add support for protocol option to fromSRA #2087 [371f858ab] +- Add retry on AWS Job definition not-found error [452cae5d8] +- Add ability to define templates library at module level #2332 [7e7d52573] +- Add missing information for pulling images from private registry in Azure Batch #2355 [040e190bd] +- Add $NXF_CLI_OPTS env variable [7d57acca5] +- Add NXF_CACHE_MODE env variable [1c345c497] +- Fix asset directory consistent hashing via sha256 checksum [4c5c0ef41] +- Fix issue invoking extension method with GString params [570e5299c] +- Fix Prevent pipeline stopping when K8s pod is evicted [f9db9cc77] +- Fix clean command for Google storage [dc9625eb9] +- Fix plugins detection in local repo [6441a3882] +- Fix S3 canned ACL documentation #2334 [69216e292] +- Fix docker image build with recent docker [2aad36897] [1e485b32b] +- Fix amazon plugin is not used when using bucketDir option [6a8c50ad4] +- Fix Plugin dependency requirement overrides core plugin #2303 [4d1762fb3] +- Fix Make K8s ImagePullBackOff and ErrImagePull recoverable #2302 [766ffde40] +- Improve cache resume strategy [0b0eae225] +- Improve GH action build compressing integration tests [ab9d747d4] +- Prevent NPE if session is not set [83bb46d94] +- Remove deprecated attribute [50d63b6fb] +- Find newest matching plugin #2303 [e6cf79ff3] +- Documents noproxy variable #2325 [bc769b1b4] +- Bump Groovy 3.0.9 [dee2d6c99] +- Bump nf-sqldb@0.2.0 +- Bump nf-amazon@1.2.1 +- Bump nf-azure@0.11.0 +- Bump nf-google@1.1.1 + +21.08.0-edge - 30 Aug 2021 +- Fix plugin updater version logging [d162eb8b4] +- Fix Nextflow launcher breaks when java path contains blanks #2265 [8097a2a90] +- Fix docker build [efb2f449b] +- Fix NPE in AnsiLogObserver #2283 [cffc683df] +- Fix run script when fixing ownership in aws batch #2262 +- Improve plugins auto start [283144474] +- Improve log error reporting [401863085] +- Improve handling of K8s node shutdown [67250c041] +- Update GitHub docs [4532b8e1e] +- Merge nf-sqldb 0.1.0 + +21.07.0-edge - 6 Aug 2021 +- Add support for AWS_MAX_ATTEMPTS variable [3cc543589] +- Add app plugin to gradle build [007bc1cb4] +- Add self pid to tower client [d2e54ea22] +- Add support for head job operationId + log/out files [a7a76cf91] +- Add enable CA Issuers option to NF launcher [8f51dc787] +- Fix Clean cmd fails removing foreign files [8bf8ab720] +- Fix Prevent script var names conflicting with private names #2246 [82bbc180e] +- Fix ENA download URL #2239 [befbabbc8] +- Fix Tower client is not activated launching all packaging #2145 [c507518c2] +- Fix orphaned AWS Batch jobs after pipeline interruption #2169 [65e2a4d05] +- Fix Process error report on target exception #1896 [1bac3f17b] +- Fix Unexpected bool conversion on publishDir enable/overwrite attributes #2220 [651835d2d] +- Fix BatchCleanup toString method [ec9bb5648] +- Improve error reporting [49ac01dbb] +- Improve Unknown host error message [ad41d1e98] +- Improve AWS Batch task handler [eb1aff275] +- Use AWS cli standard retry mode by default [f2f1fdea4] +- Report warn on cache hashing failures [7bf93de06] [3b579c954] + +21.06.0-edge - 3 Jul 2021 +- Add Keep alive option to Google LS executor [994222074] +- Add support for FTP proxy and proxy servers authentication [8ec33b04d] +- Add support for plugins groupping [aa5bc7d34] +- Add More details about the reason why a AWS Batch job has failed #2146 [27a4e88b2] +- Add support for extensions priority [ae083f1aa] +- Add stubRun attribute to workflow metadata #2164 [86cfc66fd] +- Add Run tasks under user accounts in Azure Batch #2157 [1c9fc4a40] +- Refactor GLS executor [2c86b79a4] [97fc49c09] +- Refactor AWS batch job def creation [89ce364c9] [986894287] +- Fix Default plugin version lookup [e0c8151d9] +- Fix Negative labels do not work as expected #2155 [491191811] +- Fix PublishDir overwriting task output files [190aa4eaf] +- Fix directory deletion strategy [b96fcedc8] +- Fix Implicit variable projectDir breaks caching #2186 [76417d273] +- Fix Prevent empty download array [9492cde5d] +- Fix output unstage with glob pattern [2d4c3dfcf] +- Fix Connection-reset crashes the workflow [3ee4fd0eb] [1400ded6d] [61bbc240a] [175c66584] +- Fix Slurm does not send soft kill message #2163 [f0ccfc7e8] +- Fix storeDir directive does not work with S3 #2141 [2e95a6a76] +- Fix maven local publish [05cfb7cf7] +- Fix GLS transfer attempts opts [f7c705db5] +- Fix build exportClasspath task [88d27f0c8] +- Fix PbsPro clusterOptions directive priority #2036 [75e3f225e] +- Disallow include nested within a workflow block [7dbf64bea] +- Upgrade AWS SDK minor version #2167 [296afaa8f] +- Improve gsutil transfer throughput [2da120b91] +- Improve config error reporting [6aa102430] + +21.05.0-edge - 28 May 2021 +- Add support for using mamba with conda (#2030) [10c8385b] +- Add AWS cli native error fail-over [fd7670ef] +- Add support for Container Registry to Az Batch executor (#2078) [12bf2da6] +- Add support for Tower workspace (#2097) [8a4dd3ab] +- Add support custom service account email in Google Cloud LifeSciences executor (#2044) [a642c9ea] +- Add support for Java 16 + Gradle 7 [caace1c5] [e2dd4510] [74e466e0] [1245ab1c] [bfc69fb6] +- Improve tower client error reporting [4efb6bf6] +- Fix Plugin install lock file is not deleted #2103 [b7fdffac] +- Fix Use caller runs policy of default thread pool #2021 [48b4e8ee] +- Fix Error reporting for malformed config [68e5ca18] +- Decrease max par transfers to 4 [c7ea816a] +- Prevent fetching aws instance type when missing container id [f5f96049] +- Use default opts for trace file creation [d8ae94bf] +- Improve Azure Batch executor error code and messages for failed Tasks (#2099) [1d5fa5d5] +- Bump groovy 3.0.8 [aa695e12] +- Bump snakeyaml@1.28 [8d361954] diff --git a/changelog/nextflow/v21.10.1.mdx b/changelog/nextflow/v21.10.1.mdx new file mode 100644 index 000000000..7fc8623f6 --- /dev/null +++ b/changelog/nextflow/v21.10.1.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v21.10.1 +date: 2021-11-18 +tags: [nextflow] +--- + +- Fix Azure batch NPE when missing pool spec [84b2983f4] +- Fix Docker bin in image PATH #2445 [d30da377a] +- Fix failing test with Java 16 [f2d01888d] +- Fix AWS_RETRY_MODE var definition in Batch job [f1a58600d] +- Add docs for AWS endpoints for China region [e96c56d1e] +- Correct description of cross #2446 [e4c7f3d98] +- Dump resolved config when log trace is enabled [2580fb108] +- Bump nf-azure@0.11.1 [eb1e6fbd2] +- Bump nf-amazon@1.3.2 - bump nxf-s3fs@1.1.2 [ae9e885a8] diff --git a/changelog/nextflow/v21.10.2.mdx b/changelog/nextflow/v21.10.2.mdx new file mode 100644 index 000000000..456a303e5 --- /dev/null +++ b/changelog/nextflow/v21.10.2.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v21.10.2 +date: 2021-11-22 +tags: [nextflow] +--- + +- Fix Azure executor fail to cleanup jobs on completion [4d5b71370] +- Fix Missing AWS SSE encryption for begin and exit task files #2452 [841e6101b] +- Fix Azure integration test [a8051bc01] +- Fix false positive detection of publishDir conflict [292b439ad] +- Make Azure executor logging less verbose [7452e386d] +- Change Azure test pool vmType [85682be7d] +- Downgrade Google NIO library to version 0.121.2 [66ae98820] +- Add java 16 and 17 to the launch.sh for debugging #2457 [3ff0a248e] diff --git a/changelog/nextflow/v21.10.3.mdx b/changelog/nextflow/v21.10.3.mdx new file mode 100644 index 000000000..c239e2070 --- /dev/null +++ b/changelog/nextflow/v21.10.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v21.10.3 +date: 2021-11-23 +tags: [nextflow] +--- + +Fix execution hang when reading empty error file [414240a1a] diff --git a/changelog/nextflow/v21.10.4.mdx b/changelog/nextflow/v21.10.4.mdx new file mode 100644 index 000000000..215834ec5 --- /dev/null +++ b/changelog/nextflow/v21.10.4.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v21.10.4 +date: 2021-11-30 +tags: [nextflow] +--- + +- Fix include no longer works for custom functions #2469 [e17f6155d] +- Bump nf-amazon@1.3.4 - bump nxf-s3fs@1.1.3 [be893dcb1] diff --git a/changelog/nextflow/v21.10.5.mdx b/changelog/nextflow/v21.10.5.mdx new file mode 100644 index 000000000..3f5d405a3 --- /dev/null +++ b/changelog/nextflow/v21.10.5.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v21.10.5 +date: 2021-12-08 +tags: [nextflow] +--- + +- Fix race condition on plugin autoload status [73a0893ce] diff --git a/changelog/nextflow/v21.10.6.mdx b/changelog/nextflow/v21.10.6.mdx new file mode 100644 index 000000000..c46496739 --- /dev/null +++ b/changelog/nextflow/v21.10.6.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v21.10.6 +date: 2021-12-21 +tags: [nextflow] +--- + +- Bump Slf4j 1.7.32 +- Bump Logback 1.2.9 diff --git a/changelog/nextflow/v21.11.0-edge.mdx b/changelog/nextflow/v21.11.0-edge.mdx new file mode 100644 index 000000000..dd75d64b4 --- /dev/null +++ b/changelog/nextflow/v21.11.0-edge.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v21.11.0-edge +date: 2021-12-05 +tags: [nextflow] +--- + +- Add process and workflow recursion (PREVIEW) [9f51155e9] +- Fix include no longer works for custom methods [6adfce099] +- Fix Azure executor fail to cleanup jobs on completion [533448be4] +- Fix Missing AWS SSE encryption for begin and exit task files #2452 [2c6665ef9] +- Fix false positive detection of publishDir conflict [6ea54eaea] +- Fix execution hang when reading empty error file [414240a1a] +- Test with java-17 LTS [c2141e826] +- Improve plugins dev root detection [b095bee15] +- Change Azure test pool vmType [ad5ad97ab] +- Downgrade Google NIO library to version 0.121.2 [896ec3abd] +- Bump nf-amazon@1.3.4 - bump nxf-s3fs@1.1.3 (6 days ago) +- Bump nf-amazon@1.3.3 nf-google@1.1.3 nf-azure@0.11.2 [92f94bfeb] +- Bump gradle 7.3.1 [2c34a3a27] diff --git a/changelog/nextflow/v21.12.1-edge.mdx b/changelog/nextflow/v21.12.1-edge.mdx new file mode 100644 index 000000000..6dac30acc --- /dev/null +++ b/changelog/nextflow/v21.12.1-edge.mdx @@ -0,0 +1,34 @@ +--- +title: Nextflow v21.12.1-edge +date: 2021-12-22 +tags: [nextflow] +--- + +- Add tags attribute to publishDir directive [e78a997b5] +- Add ability to disable running jobs cancellation [a13af9a3c] +- Add ability to define containerProperties with using AWS Batch #2471 [ac7f1e71e] +- Add NXF_JVM_ARGS env variable [7afb2deed] +- Improve paths validation [0849d583f] +- Include S3FS provider into nf-amazon plugin [3a7bf8c7a] +- Fix error reporting on missing script file #1951 [e1a0b240a] +- Fix singularity docs #2493 [c66cb3ba7] +- Fix cross compilation error cause by ByteBuffer [74916100f] +- Fix File staging race condition + beta AWS parallel downloader [b7c262de3] +- Fix enableAIAcaIssuers launcher flag [cd780aabd] +- Fix task index sequence generation [3447e735b] +- Fix Changes process directives invalidates tasks cache [967c1adff] +- Fix Interrupted download of staged files cause execution to fail #1552 [847789fad] +- Fix plugins start/stop for fs command [88d8be1f4] +- Fix for nested params with the same name #2485 [02de4147c] +- Fix race condition on plugin autoload status [ab00a50f5] +- Fix failing test with Java 17 [1c6183c92] [4daf8d0a1] +- Note on Azure Batch inactive pools #2483 [7fc116067] +- Remove drip launcher [909f95279] +- Update azure test image [de9d5ee8c] +- Update logging library [a957db646] +- Bump nf-google@1.1.4 [93193a3f3] +- Bump version 21.12.0-edge [9cb7ee81f] +- Bump AWS sdk 1.12.129 [bd7ba1706] +- Bump logback 1.2.9 [29f260717] +- Bump Jsoup 1.14.3 [5776c0391] +- Bump corretto:17.0.1 [f7e047ea4] diff --git a/changelog/nextflow/v22.01.0-edge.mdx b/changelog/nextflow/v22.01.0-edge.mdx new file mode 100644 index 000000000..7ab719276 --- /dev/null +++ b/changelog/nextflow/v22.01.0-edge.mdx @@ -0,0 +1,35 @@ +--- +title: Nextflow v22.01.0-edge +date: 2022-02-07 +tags: [nextflow] +--- + +21.12.1-edge - 22 Dec 2021 +- Add tags attribute to publishDir directive [e78a997b5] +- Add ability to disable running jobs cancellation [a13af9a3c] +- Add ability to define containerProperties with using AWS Batch #2471 [ac7f1e71e] +- Add NXF_JVM_ARGS env variable [7afb2deed] +- Improve paths validation [0849d583f] +- Include S3FS provider into nf-amazon plugin [3a7bf8c7a] +- Fix error reporting on missing script file #1951 [e1a0b240a] +- Fix singularity docs #2493 [c66cb3ba7] +- Fix cross compilation error cause by ByteBuffer [74916100f] +- Fix File staging race condition + beta AWS parallel downloader [b7c262de3] +- Fix enableAIAcaIssuers launcher flag [cd780aabd] +- Fix task index sequence generation [3447e735b] +- Fix Changes process directives invalidates tasks cache [967c1adff] +- Fix Interrupted download of staged files cause execution to fail #1552 [847789fad] +- Fix plugins start/stop for fs command [88d8be1f4] +- Fix for nested params with the same name #2485 [02de4147c] +- Fix race condition on plugin autoload status [ab00a50f5] +- Fix failing test with Java 17 [1c6183c92] [4daf8d0a1] +- Note on Azure Batch inactive pools #2483 [7fc116067] +- Remove drip launcher [909f95279] +- Update azure test image [de9d5ee8c] +- Update logging library [a957db646] +- Bump nf-google@1.1.4 [93193a3f3] +- Bump version 21.12.0-edge [9cb7ee81f] +- Bump AWS sdk 1.12.129 [bd7ba1706] +- Bump logback 1.2.9 [29f260717] +- Bump Jsoup 1.14.3 [5776c0391] +- Bump corretto:17.0.1 [f7e047ea4] diff --git a/changelog/nextflow/v22.02.0-edge.mdx b/changelog/nextflow/v22.02.0-edge.mdx new file mode 100644 index 000000000..9404b574a --- /dev/null +++ b/changelog/nextflow/v22.02.0-edge.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v22.02.0-edge +date: 2022-02-25 +tags: [nextflow] +--- + +22.02.0-edge - 25 Feb 2022 +- Fix Prevent S3 tagging with empty list [ae7db466] +- Fix Azure repos tests [856aacf0] +- Fix isse on includeConfig resolution #2675 [6591a9e1] +- Fix NPE when accessing not existing Git file [6c79f8fd] +- Fix Batch Job name exceed max allowed size [e8b70ca3] +- Fix detect and skip bom mark in files (#2645) [02b06ba3] +- Feature: Abort session if publish fails (#2643) [79b3836b] +- Fix report overwrite cannot be disabled [202b5c9c] #2647 +- Fix match bash interpreter irrespective the path [c2d2b9b2] +- Fix build warning + plugins assemble (#2634) [00dd143a] +- Fix CITATION.cff and add automatic validation of your citation metadata [15698a45] +- Bump nf-amazon@1.5.1 [a4496bb2] +- Bump nf-amazon@1.5.2 [e51139bb] diff --git a/changelog/nextflow/v22.02.1-edge.mdx b/changelog/nextflow/v22.02.1-edge.mdx new file mode 100644 index 000000000..72dd7ad1e --- /dev/null +++ b/changelog/nextflow/v22.02.1-edge.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.02.1-edge +date: 2022-03-03 +tags: [nextflow] +--- + +- Prevent multiple parsing of params file [38bb1f71] diff --git a/changelog/nextflow/v22.03.0-edge.mdx b/changelog/nextflow/v22.03.0-edge.mdx new file mode 100644 index 000000000..faf697964 --- /dev/null +++ b/changelog/nextflow/v22.03.0-edge.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v22.03.0-edge +date: 2022-03-27 +tags: [nextflow] +--- + +- Add experimental proxy reg [b3836691] +- Add api to access config raw value [977f6305] +- Add warning for invalid emit names [0045834c] +- Add retry policy on grid submit failure #2696 [673f560c] +- Add config tests #2422 [885993b1] +- Add ability to disable config names check [814a2605] +- Add azcopy fine grain config settings [3998a56b] +- Add binary compatibility with Java 8 [763ec999] +- Add retry policy to Az Batch operations [991c6175] +- Make DSL2 default syntax [4e9189ac] [0c80784a] +- Fix Reduce task command runner script size [6930408b] +- Fix K8s task retry strategy on node termination [bd093081] +- Fix use first config in stack when is into profile #2701 [44bdde8d] +- Fix Allow comments after nextflow.enable.dsl (#2746) [6988638b] +- Fix allow blank spaces in java path (#2690) [a966020e] +- Improve AWS Batch job retry on spot termination [bd8f2e26] [72fbda848] +- Improve error reporting [55466be7] +- Undeprecate merge operation [1649944b] +- Bump support for Java 18 [f3a11e4c] +- Prevent invalid use of large maxForks values [5de0c200] +- Prevent race condition on thread pool creation [3e707a1d] +- Refactor AWS batch job unique token generation [d64f5a21] +- Decrese log verbosity [9237d587] [d1a5e5a8] +- Throw an error if a required secret is missing [8e5129d6] +- Wait for pod to stop running before shutdown (#2667) [505c5ad6] +- Restore AZ tests [858a4568] diff --git a/changelog/nextflow/v22.03.1-edge.mdx b/changelog/nextflow/v22.03.1-edge.mdx new file mode 100644 index 000000000..96af26274 --- /dev/null +++ b/changelog/nextflow/v22.03.1-edge.mdx @@ -0,0 +1,17 @@ +--- +title: Nextflow v22.03.1-edge +date: 2022-04-06 +tags: [nextflow] +--- + +- Fix default dsl env detection [b9a09bf6] +- Handle K8s timeout error - 500 status code (#2756) [89a1a46b] +- Honour background option for kuberun command [b1b0ddd9] +- Add Aws Batch native retry on spot reclaim [cd95e297] +- Improve Aws Batch error reporting [00443510] +- Add missing workflow err report [fa687789] +- Use local nextflow when packing docker image (#2757) [40271b08] +- Add retry policy Azure create job [792820a2] +- Fix log message in nf-azure [80a0e937] +- Prevent build on tag [5b660c73] +- Fix missing linux/amd64 platform on docker build [05f117d7] diff --git a/changelog/nextflow/v22.04.0.mdx b/changelog/nextflow/v22.04.0.mdx new file mode 100644 index 000000000..a414825c6 --- /dev/null +++ b/changelog/nextflow/v22.04.0.mdx @@ -0,0 +1,180 @@ +--- +title: Nextflow v22.04.0 +date: 2022-04-23 +tags: [nextflow] +--- + +- Improve error reporting (#2658) [e6ef017d] +- Document params-file and improve self-update (#2673) [1e008f47] +- Add support for AWS S3 anonymous credentials (#2810) [ae7ba35a] +- Add tolerations K8s pod option (#2763) [7f7cdadc] +- Add support for batched queries to nf-sqldb plugin [3a9dad8b] +- Add `emitColumns` option fromQuery operator [6a6a6eac] +- Add mermaid DAG renderer [653f1e57] +- Fix missing SSE flag on AWS Batch job submit (#2809) [4b3e946d] +- Fix Task execution is not evicted on unexpected execution error (#2787) [05ea0c86] +- Document params-file and improve self-update (#2673) [1e008f47] +- Improve deprecation message (#2788) [720a84d7] +- General docs improvements (#2800) [88acd26b] +- Decrease Aws upload chunk size to 20 MB [086138fb] +- Improve error reporting (#2658) [e6ef017d] +- Improve err reporting for Azure Batch [798bae1f] +- Rename echo directive to debug (#2776) [8f906aa5] +- Remove embedded Read The Docs theme [728d545f] +- Use a remote config in kuberun (#2781) [5485b699] +- Start Github Actions also for edited PRs (#2796) [78f5c10f] +- Deprecate isDsl2Final method [0f63f1a7] +- Document task object [1c83e21e] +- Bump nf-sqldb@0.4.0 [a137e93a] +- Bump nf-amazon@1.7.1 [912b9bb2] +- Bump moment.js version2.29.2 [a229c1ed] + +22.03.1-edge - 6 Apr 2022 +- Fix default dsl env detection [b9a09bf6] +- Handle K8s timeout error - 500 status code (#2756) [89a1a46b] +- Honour background option for kuberun command [b1b0ddd9] +- Add Aws Batch native retry on spot reclaim [cd95e297] +- Improve Aws Batch error reporting [00443510] +- Add missing workflow err report [fa687789] +- Use local nextflow when packing docker image (#2757) [40271b08] +- Add retry policy Azure create job [792820a2] +- Fix log message in nf-azure [80a0e937] +- Prevent build on tag [5b660c73] +- Fix missing linux/amd64 platform on docker build [05f117d7] + +22.03.0-edge - 27 Mar 2022 +- Add experimental proxy reg [b3836691] +- Add API to access config raw value [977f6305] +- Add warning for invalid emit names [0045834c] +- Add retry policy on grid submit failure #2696 [673f560c] +- Add config tests #2422 [885993b1] +- Add ability to disable config names check [814a2605] +- Add azcopy fine grain config settings [3998a56b] +- Add binary compatibility with Java 8 [763ec999] +- Add retry policy to Az Batch operations [991c6175] +- Make DSL2 default syntax [4e9189ac] [0c80784a] +- Fix Reduce task command runner script size [6930408b] +- Fix K8s task retry strategy on node termination [bd093081] +- Fix use first config in stack when is into profile #2701 [44bdde8d] +- Fix Allow comments after nextflow.enable.dsl (#2746) [6988638b] +- Fix allow blank spaces in java path (#2690) [a966020e] +- Improve AWS Batch job retry on spot termination [bd8f2e26] [72fbda848] +- Improve error reporting [55466be7] +- Undeprecate merge operation [1649944b] +- Bump support for Java 18 [f3a11e4c] +- Prevent invalid use of large maxForks values [5de0c200] +- Prevent race condition on thread pool creation [3e707a1d] +- Refactor AWS batch job unique token generation [d64f5a21] +- Decrese log verbosity [9237d587] [d1a5e5a8] +- Throw an error if a required secret is missing [8e5129d6] +- Wait for pod to stop running before shutdown (#2667) [505c5ad6]) +- Restore AZ tests [858a4568] + +22.02.1-edge - 3 Mar 2022 +- Prevent multiple parsing of params file [38bb1f71] + +22.02.0-edge - 25 Feb 2022 +- Fix Prevent S3 tagging with empty list [ae7db466] +- Fix Azure repos tests [856aacf0] +- Fix isse on includeConfig resolution #2675 [6591a9e1] +- Fix NPE when accessing not existing Git file [6c79f8fd] +- Fix Batch Job name exceed max allowed size [e8b70ca3] +- Fix detect and skip bom mark in files (#2645) [02b06ba3] +- Feature: Abort session if publish fails (#2643) [79b3836b] +- Fix report overwrite cannot be disabled [202b5c9c] #2647 +- Fix match bash interpreter irrespective the path [c2d2b9b2] +- Fix build warning + plugins assemble (#2634) [00dd143a] +- Fix CITATION.cff and add automatic validation of your citation metadata [15698a45] +- Bump nf-amazon@1.5.1 [a4496bb2] +- Bump nf-amazon@1.5.2 [e51139bb] + +22.01.0-edge - 7 Feb 2022 +- Add support for Tower reports (#2523) [de3d76349] +- Add RateLimitExceededException when GitHub api limit is reached [ff123c605] +- Add fetch tags and branches to local git provider [e1de8e0ac] +- Add K8s priorityClassName pod option, updated tests (#2585) [51650f8c4] +- Add securityContext pod option to docs (#2584) [19f16f0da] +- Add automountServiceAccountToken option for k8s executor (#2562) [1b5908e4c] +- Add warn about AWS CLI grandparent path in container (#2565) [67073b0c5] +- Add affinity option to pod directive (#2522) [640cbed48](3 weeks ago) +- Add ability to specify memory/cpu resources for the control pod (#2559) [13f3e036d] +- Add `-entry` parameter to pass in k8s executor (#2525) [a96233af6] +- Add AWS Athena JDBC driver for nf-sqldb plugin (#2500) [462575f05] +- Fix process output 'env' as array (#2624) [0a246dc2c] +- Fix make date format to change independent from system locale [d1e5f6e76] +- Fix double access of params file [459ebab7b] +- Fix Use account SAS token instead of service SAS token (#2576) [d5125975d] +- Fix upload of nested directory outputs on azure (#2578) [85ad55225] [744447155] +- Fix Docs Typo (#2556) [942be46f6] +- Fix NXF_PARAMS_FILE is not recognised #2549 [62f5fe1d9] +- Fix failing tests (4 weeks ago) +- Fix Unable to use output path with nested properties [ceceb0784] +- Fix Nextflow couldn't parse generated nextflow.config under some circumstances (#2496) [2dfbbc63c] +- Fix invalid use of `var` keyword [8418cc8d6] +- Improve k8s executor throwing NodeTerminationException on node shutdown (#2590) [084c8d6ca] +- Improve docs on `include` statements (#2520) [9c140cee3] +- Improve core plugins info & logging [dfa544ac9] +- Improve Secrets handling [1c0ad4679] [329502d19] [[26b4be906]] +- Improve DSL2 documentation [048b026f2] [e2e8b5557] +- Improve documentation (#2600) [787a1fd84] +- Allow disabling history file unique check [c3677c311] +- Make S3 parallel download as default [b490f146d] [03dae9d6e] +- Run Azure integration tests only with Java 11 [0890ceeb3] +- Prepare for Java >= 11 build [8c0566fc3] [5ba16dd18] [405b67365] +- Use Standard_A3 instance type for Azure tests [67e7d3ab3] [b97b0010c] +- Refactor cache store using plugins [54bf7a61d] +- Update google cloud docs (#2594) [dfa867953] +- Update the azure docs for registry [96baf288e] +- Update copyright info [807a816a5] +- Remove gradle logs about tasks dependencies (#2618) [cae44e00b] +- Remove Tika deps for nf-amazon module [95620d42b] +- Remove deprecated validExitStatuas directive [b3117e789] [2188d51a0] +- Remove support for Apache Ignite [d4dc1cfe1] [64d2773fd] +- Bump nf-amazon@1.5.0 as default plugin +- Bump Gradle 7.3.3 [f00bfb0d3] +- Bump nf-amazon@1.5.0 [40f90aa92] [[2bc16732e]] + +21.12.1-edge - 22 Dec 2021 +- Add tags attribute to publishDir directive [e78a997b5] +- Add ability to disable running jobs cancellation [a13af9a3c] +- Add ability to define containerProperties with using AWS Batch #2471 [ac7f1e71e] +- Add NXF_JVM_ARGS env variable [7afb2deed] +- Improve paths validation [0849d583f] +- Include S3FS provider into nf-amazon plugin [3a7bf8c7a] +- Fix error reporting on missing script file #1951 [e1a0b240a] +- Fix singularity docs #2493 [c66cb3ba7] +- Fix cross compilation error cause by ByteBuffer [74916100f] +- Fix File staging race condition + beta AWS parallel downloader [b7c262de3] +- Fix enableAIAcaIssuers launcher flag [cd780aabd] +- Fix task index sequence generation [3447e735b] +- Fix Changes process directives invalidates tasks cache [967c1adff] +- Fix Interrupted download of staged files cause execution to fail #1552 [847789fad] +- Fix plugins start/stop for fs command [88d8be1f4] +- Fix for nested params with the same name #2485 [02de4147c] +- Fix race condition on plugin autoload status [ab00a50f5] +- Fix failing test with Java 17 [1c6183c92] [4daf8d0a1] +- Note on Azure Batch inactive pools #2483 [7fc116067] +- Remove drip launcher [909f95279] +- Update azure test image [de9d5ee8c] +- Update logging library [a957db646] +- Bump nf-google@1.1.4 [93193a3f3] +- Bump version 21.12.0-edge [9cb7ee81f] +- Bump AWS sdk 1.12.129 [bd7ba1706] +- Bump logback 1.2.9 [29f260717] +- Bump Jsoup 1.14.3 [5776c0391] +- Bump corretto:17.0.1 [f7e047ea4] + +21.11.0-edge - 5 Dec 2021 +- Add process and workflow recursion (PREVIEW) [9f51155e9] +- Fix include no longer works for custom methods [6adfce099] +- Fix Azure executor fail to cleanup jobs on completion [533448be4] +- Fix Missing AWS SSE encryption for begin and exit task files #2452 [2c6665ef9] +- Fix false positive detection of publishDir conflict [6ea54eaea] +- Fix execution hang when reading empty error file [414240a1a] +- Test with java-17 LTS [c2141e826] +- Improve plugins dev root detection [b095bee15] +- Change Azure test pool vmType [ad5ad97ab] +- Downgrade Google NIO library to version 0.121.2 [896ec3abd] +- Bump nf-amazon@1.3.4 - bump nxf-s3fs@1.1.3 (6 days ago) +- Bump nf-amazon@1.3.3 nf-google@1.1.3 nf-azure@0.11.2 [92f94bfeb] +- Bump gradle 7.3.1 [2c34a3a27] diff --git a/changelog/nextflow/v22.04.1.mdx b/changelog/nextflow/v22.04.1.mdx new file mode 100644 index 000000000..5f6d28fc5 --- /dev/null +++ b/changelog/nextflow/v22.04.1.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v22.04.1 +date: 2022-05-15 +tags: [nextflow] +--- + +- Improve dsl detection [739b959f] +- Improve missing workflow err message [f3fc081b] (#2871) +- Fix Aws Batch retry policy on spot reclaim [d855f0d9] +- Update default SKU for Azure Batch (#2868) [be60fc14] +- Bump nf-amazon 1.7.2 +- Bump nf-azure 0.13.2 diff --git a/changelog/nextflow/v22.04.2.mdx b/changelog/nextflow/v22.04.2.mdx new file mode 100644 index 000000000..326565677 --- /dev/null +++ b/changelog/nextflow/v22.04.2.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.04.2 +date: 2022-05-16 +tags: [nextflow] +--- + +- Fix stackoverflow error when probe dsl [a05fcbea] diff --git a/changelog/nextflow/v22.04.3.mdx b/changelog/nextflow/v22.04.3.mdx new file mode 100644 index 000000000..1efe53aac --- /dev/null +++ b/changelog/nextflow/v22.04.3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.04.3 +date: 2022-05-18 +tags: [nextflow] +--- + +- Fix dsl1 detection (#2879) [1a7ea0d1] diff --git a/changelog/nextflow/v22.04.4.mdx b/changelog/nextflow/v22.04.4.mdx new file mode 100644 index 000000000..a30b7c715 --- /dev/null +++ b/changelog/nextflow/v22.04.4.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v22.04.4 +date: 2022-06-19 +tags: [nextflow] +--- + +- Fix Publish copy mode for s3 based path [bb510ce6] +- Add strict mode config setting [b0567e62] +- Update docker base image [b00c1418] diff --git a/changelog/nextflow/v22.04.5.mdx b/changelog/nextflow/v22.04.5.mdx new file mode 100644 index 000000000..9a5a15c84 --- /dev/null +++ b/changelog/nextflow/v22.04.5.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.04.5 +date: 2022-07-15 +tags: [nextflow] +--- + +- Allow fully disabling history file [1a36c9bc] diff --git a/changelog/nextflow/v22.05.0-edge.mdx b/changelog/nextflow/v22.05.0-edge.mdx new file mode 100644 index 000000000..c1aaa5ba0 --- /dev/null +++ b/changelog/nextflow/v22.05.0-edge.mdx @@ -0,0 +1,44 @@ +--- +title: Nextflow v22.05.0-edge +date: 2022-05-25 +tags: [nextflow] +--- + +- Add Hyperqueue executor (#2896) [ffa5712e] +- Add support for K8s Job resource [c70eb12d] +- Add support for time process directive in GLS executor (#2880) [1402e183] +- Add support for priviledge option for K8s containers [7ffe3a02] +- Add DSL1 option to docs (#2836) [d30841a5] +- Add support for container options to Azure Batch [3f4f00f9] +- Add support for move operation to AWS S3 [8c0ddfd5] +- Add K8s execution hostname in the trace file (#2828) [ebaef92a] +- Add support for AWS S3 encyption using a custom KMS key [c1e45aa9] +- Add support for Micromamba [383e023f] +- Add jaxb-api dependecy to nf-amazon [c1a09f87] +- Add strict mode config setting [ci fast] [696e70b5] +- Add -head-prescript option to kuberun (#2830) [9e387055] +- Fix missing err message on submit failure [233e67f0] (#2899) +- Fix resolve azure devops repositories when projectId is present [2500ff01] +- Fix AthenaJdbc into distribution zip [853a1f2a] [4b3579d5] [70ef7ee3] +- Fix Inconsistent bool parsing #2881 [40bf2b2a] +- Fix Unable to pull pipeline if config file is not in default branch (#2876) [4ee5b04f] +- Fix Prevent crash when scratch dir does not exist (#2888) [9ef44ae5] +- Fix DSL1 detection to invalid workflow keyword matching [fe0700b0] (#2879) +- Fix Aws Batch retry policy on spot reclaim [6e029b79] +- Fix 'false' string in config interpreted as true (#2865) [079a18ce] +- Improve Git Provider config logging [d7dbca8ec] +- Improve K8s task handler [1822b2ca] +- Improve missing workflow err message [da101e8f] (#2871) +- Include revision in the Azure Repos provider when specified (#2861) [3342c767] +- Remove unnecessary change dir echo [372d1f47] +- Abort execution when accessing undefined params with strict mode [93836081] +- Update docker base image [50cd7956] +- Update default SKU for Azure Batch (#2868) [9ea09dba] ] +- Update dependencies [405d9545] +- Refactoring to prevent name conflict [aba2671b] +- Few DSL syntax to explicit declaration of plugin extensions (#2820) [bfc4a067] +- Sanitize k8s label and annotation keys, don't sanitize annotation value (#2843) [5287a984] +- Docs improvement (#2835) [09e5bca3] +- Bump Jgit 6.1 [7186348c] +- Bump Spock 2.1 [51100d16] +- Bump capsule 1.1.1 [20ec1697] diff --git a/changelog/nextflow/v22.06.0-edge.mdx b/changelog/nextflow/v22.06.0-edge.mdx new file mode 100644 index 000000000..746486255 --- /dev/null +++ b/changelog/nextflow/v22.06.0-edge.mdx @@ -0,0 +1,21 @@ +--- +title: Nextflow v22.06.0-edge +date: 2022-06-09 +tags: [nextflow] +--- + +- Add AWS CodeCommit initial support [80fba6e9] +- Add support for 307 and 308 HTTP redirection [92382012] +- Add DirWatcher v2 [209c82cd] +- Add Moriondo in the list of random names [e0abca58] +- Add preview CLI option (#2914) [aa8f1aa4] +- Fix Git config resultion error [64436697] +- Fix StackOverflowError when dump all profiles (#2922) [28cd11a2] +- Fix gradle warning message in nf-sqldb (#2921) [b09ceabe] +- Fix log for LsfExecutror perTaskReserve attribute [7c3ec874] +- Fix external pod deletion for jobs (#2915) [4dd1af7a] +- Prevent function overloading in module definition [c0b522ab] +- Improve error message of non sensical include (#2623) [285fe49c] +- Mount PWD path only when scratch is used [9b3c6e31] +- Stripe sensitive data into strings (#2908) [7fa4c86c] +- Dump scm content when trace is enabled [c3117ada] diff --git a/changelog/nextflow/v22.06.1-edge.mdx b/changelog/nextflow/v22.06.1-edge.mdx new file mode 100644 index 000000000..94eea995b --- /dev/null +++ b/changelog/nextflow/v22.06.1-edge.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.06.1-edge +date: 2022-06-17 +tags: [nextflow] +--- + + diff --git a/changelog/nextflow/v22.07.1-edge.mdx b/changelog/nextflow/v22.07.1-edge.mdx new file mode 100644 index 000000000..fe35598f3 --- /dev/null +++ b/changelog/nextflow/v22.07.1-edge.mdx @@ -0,0 +1,27 @@ +--- +title: Nextflow v22.07.1-edge +date: 2022-07-13 +tags: [nextflow] +--- + +- Add support for Google Batch API v1 [4c116d58] [e85d87ee] +- Add time directive support for K8s executor (#2948) [2b6f70a8] +- Add docs aws.client.s3PathStyleAccess config (#3000) [20005500] +- Allow to override lsf.conf settings with nextflow config #2862 [dae191a1] +- Allow hybrid containers execution [0af1bcb3] +- Improve error msg when script file cannot be read [52c2780e] +- Improve error reporting for custom function [877c7931] +- Improve error message for missing plugin extension [4a43db84] +- Improve test #3019 [7c37e0be] +- Rename kuberun -pod-image to -head-image [2576ba62] +- Externalise sqldb plugin source code [17e80b4f] +- Fix escape unstage outputs with double quotes #2912 #2904 #2790 [49ff02a6] +- Fix Exception when settings AWS Batch containerOptions #3019 [89312ad8] +- Fix Missing query param in http file (#2918) [43cc8511] +- Fix Publish copy mode for S3 based path [085f6b2b] +- Fix Fail fast uploads to S3 (#2969) [7fd1a6e1] +- Fix null script name in launch info [7118849f] +- Bump commons-code@1.15 [a06b4442] +- Bump jgit@6.2.0 [3331826f] +- Bump snakeyaml@1.30 [de62fd3f] +- Bump gson@2.8.9 [3234ddd5] diff --git a/changelog/nextflow/v22.08.0-edge.mdx b/changelog/nextflow/v22.08.0-edge.mdx new file mode 100644 index 000000000..660a02c38 --- /dev/null +++ b/changelog/nextflow/v22.08.0-edge.mdx @@ -0,0 +1,50 @@ +--- +title: Nextflow v22.08.0-edge +date: 2022-08-01 +tags: [nextflow] +--- + +### 22.08.0-edge - 1 Aug 2022 +- Add warning to env config docs (#3083) [ca933c16] +- Add -with-conda CLI option (#3073) [98b2ac80] +- Add simple wave plugin cli commands [8888b866] +- Add default wave plugin [7793a0ec] +- Add boot disk, cpu platform to Google Batch (#3058) [17a8483d] +- Add support for GPU accelerator to Google Batch (#3056) [f34ad7f6] +- Add support for archive dir to tower plugin [c234681a] +- Add support tower cache backup/restore [bc2f9d13] +- Add disk directive to google batch (#3057) [ec6e290c] +- Add retry when Azure submit fails with OperationTimedOut [6a3f9742] +- Add warning when Google Batch quota is exceeded (#3066) [6b9c52ad] +- Allow fully disabling history file [0a45f858] +- Allow the support function overloading and default parameters (#3011) [042d3857] +- Improve S3 file upload/download via Transfer manager [7e8d2a5a] +- Prevent overriding container entrypoint [b3a4bf85] +- Update FileTransfer pool settings [503aafce] +- Remove deprecated commands [93228b4b] +- Prevent nextflow config to break tower launch [e059a724] +- Refactor Google Batch executor to use Java API (#3044) [31a6e85c] +- Fix Unable to disable scratch attribute with AWS Batch [1770f73a] +- Fix unit test setting explicit permissions for test files [1c821139] +- Fix Default plugins are overriden by config plugins [46cf3bfa] +- Fix S3 transfer download directory [b7bf9fe5] +- Fix NPE while setting S3 ObjectMetada #3031 [d6163431] +- Fix Unable to retrieve AWS batch instance type #1658 [3c4d4d3b] +- Fix AWS Batch job definition conflict (#3048) [e5084418] +- Fix JAVA_TOOL_OPTIONS breaking launch #1716 [0e7b416d] +- Fix add ps shared objects to Dockerfile (#3033) [1c23b40a] +- Parallelize build integration tests [807800a3] +- Bump google-cloud-nio:0.124.8 [dfaa9d19] +- Bump groovy 3.0.12 [5c900b91] +- Bump Moment.js 2.29.4 [a9ced868] +- Bump gson@2.9.0 [12f17176] +- Bump nf-azure@0.13.4 +- Bump nf-google@1.4.0 +- Bump nf-tower@1.5.0 +- Bump nf-wave@0.2.1 +- Bump nf-amazon@1.9.0 + +### Breaking changes +- The container entrypoint is not overridden anymore with `/bin/bash` by Nextflow when using Local, Kubernetes and batch scheduler executors. This has been made for consistency with the AWS, Google and Azure Batch executors that do not set it either. Make sure the containers used in your pipeline use `sh` or `bash` as the default entry point. If you want to continue to use the old behaviour set the variable `NXF_CONTAINER_ENTRYPOINT_OVERRIDE=true` in the launch environment +- The use of Conda environment defined in the process definition via the `conda` directive needs to be enabled in an explicit manner using either the CLI option `-with-conda` or using the config setting `conda.enabled=true` or setting environment variable `NXF_CONDA_ENABLED=true`. See https://github.com/nextflow-io/nextflow/pull/3073 for details. + diff --git a/changelog/nextflow/v22.08.1-edge.mdx b/changelog/nextflow/v22.08.1-edge.mdx new file mode 100644 index 000000000..1ba864480 --- /dev/null +++ b/changelog/nextflow/v22.08.1-edge.mdx @@ -0,0 +1,25 @@ +--- +title: Nextflow v22.08.1-edge +date: 2022-08-11 +tags: [nextflow] +--- + +- Add support for disabling config include [e0859a12] +- Add experimental fusion support [1854f1f2] +- Add support for plugin provided function extension (#3079) [16230c2b] +- Add support for AWS Batch logs group (#3092) [4ef043ac] +- Add share identifier to Aws Batch (#3089) [c0253aba] +- Improve Tower cache manager [0091afc5] +- Improve S3 copy via xfer manager [02d2beae] +- Reports a warning when using NXF vars in the config [009ec256] +- Make wake token cache duration config [5f955fc9] +- Patch unable to start non-core plugin [a55f58ff] +- Increase S3 upload chunk size to 100 MB [9c94a080] +- Change Google Batch disk directive to override boot disk size (#3097) [7e1c0686] +- Fix queueSize setting is not honoured by AWS Batch executor (#3093) [d07bb52b] +- Fix Allow disabling scratch with Google Batch [e8e5c721] +- Fix Emit relative path when relative parameter is set (#3072) [39797759] +- Bump nf-wave@0.3.0 [e46d341d] +- Bump nf-tower@1.5.1 [cdc2be53] +- Bump nf-google@1.4.1 [c39935a5] +- Bump nf-amazon@1.10.0 [ccdf62d0] diff --git a/changelog/nextflow/v22.08.2-edge.mdx b/changelog/nextflow/v22.08.2-edge.mdx new file mode 100644 index 000000000..a56d3bd51 --- /dev/null +++ b/changelog/nextflow/v22.08.2-edge.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v22.08.2-edge +date: 2022-08-16 +tags: [nextflow] +--- + +- Fix queueSize setting is not honoured by AWS Batch executor (again) #3117 [1733bb2e] +- Add `files()` method to docs (#3123) [00bb8896] +- Refactor wave packing [bc876986] +- Improve logging [aa380d5f] +- Update dockerfile [e6329282] diff --git a/changelog/nextflow/v22.09.1-edge.mdx b/changelog/nextflow/v22.09.1-edge.mdx new file mode 100644 index 000000000..f3d967910 --- /dev/null +++ b/changelog/nextflow/v22.09.1-edge.mdx @@ -0,0 +1,28 @@ +--- +title: Nextflow v22.09.1-edge +date: 2022-09-01 +tags: [nextflow] +--- + +- Add support for Charliecloud v0.28 (#3116) [84f43a33] +- Add Support for EC-encrypted keys for K8s client [fd759d09] +- Add support for Bridge batch scheduler (#3106) [343c17e6] +- Add fusion support to local executor [17160bb0] [6cfb51e7] +- Add getTags and getBranches to BitBucketServer [53bd89cd] +- Add retry strategy to httpfs client [55f9c87b] +- Add support for project resources [c2ad6566] +- Add mamba build options [987a13cb] +- Fix Do not override tower endpoint in the config [41fb1ad0] +- Fix Hyperqueue job names must be less than 40 chars #3151 [8e43670b] +- Fix typo in ConfigBuilder.groovy (#3143) [659e6108] +- Fix Resume for dynamically resolved containers [13483ff2] +- Improve fusion env handling [10f35b60] +- Improve foreign file(s) cache detection logic [3a9352c8] +- Rename ModuleBundle to ResourcesBundle [0e51dc0f] +- Use quiet output mode for Hyperqueue executor (#3103) [70a91fdf] +- Wave improve Conda settings [6f087fec] +- Improve secrets cmd (#3158) [115b2f3d] +- Improve Wave resolution strategy [2eb700c6] +- Improve Az Batch err handling and testing [85d31e8d] +- Bump google-cloud-batch 0.2.2 +- Bump Spock 2.2 diff --git a/changelog/nextflow/v22.09.2-edge.mdx b/changelog/nextflow/v22.09.2-edge.mdx new file mode 100644 index 000000000..f5225ab0e --- /dev/null +++ b/changelog/nextflow/v22.09.2-edge.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v22.09.2-edge +date: 2022-09-07 +tags: [nextflow] +--- + +- Fix thread pool race condition on shutdown [8d2b0587] +- Fix Intermediate multipart upload requires a minimum size (#3193) [0b66aed6] +- Fix fusion enable detection [3ef91512] +- Add before-afterScript warning to docs (#3167) [09464590] +- Add httpReadTimeout and httpConnectTimeout config to K8s client [064f9bc4] +- Add support for Wave build & cache repos [98a275ba] +- Finalise secrets feature (#3161) [49021b82] +- Update executor retry config docs (#3001) [aed6c234] +- Change Azure test pool name [0c724504] +- Improve Wave error reporting [b11d0f11] +- Remove unneeded launcher file remapping [a255118d] +- Update Azure vm types [80f5fbe4] +- Update docs logos (#3174) [529bad81] diff --git a/changelog/nextflow/v22.09.3-edge.mdx b/changelog/nextflow/v22.09.3-edge.mdx new file mode 100644 index 000000000..455873d87 --- /dev/null +++ b/changelog/nextflow/v22.09.3-edge.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v22.09.3-edge +date: 2022-09-10 +tags: [nextflow] +--- + +- Add Fusion support to K8s executor (#3142) [6bb27b32] +- Fix shutdown/cleanup hooks invocation [f4185070] +- Fix Use smaller buffer size for S3 stream uploader [8c643074] [9926d15d] +- Fix Azure NPE on missing pool opts [d5c0aabd] +- Fix handling of targetDir when using Fusion fs [2091b272] +- Document aws.batch.retryMode config (#3195) [56f75e0c] diff --git a/changelog/nextflow/v22.09.4-edge.mdx b/changelog/nextflow/v22.09.4-edge.mdx new file mode 100644 index 000000000..f1ac884d3 --- /dev/null +++ b/changelog/nextflow/v22.09.4-edge.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v22.09.4-edge +date: 2022-09-19 +tags: [nextflow] +--- + +- Add Fusion display name [f789d457] +- Add container cleanup [cd2ae7dc] +- Add Wave interactive debug session [ce7fa651] +- Add support for wave build and cache repositories[692043ff] +- Add shutdown to Google Batch client [8f413cf7] +- Add native_id to Google Batch handler [352b4239] +- Add java sts library to enable use of IRSA in k8s (#3207) [62df42c3] +- Add support for module custon bin dirs [77f55262] +- Add support for tower token to wave client [928d5b04] +- Update CLI docs (#3200) [8acebee6] +- Fix issue with empty report file [9cc4f079] +- Do not return resource bundle for root module [775c7ed9] +- Improve tower config [ee03c243] +- Bump groovy 3.0.13 [4a17e198] diff --git a/changelog/nextflow/v22.09.5-edge.mdx b/changelog/nextflow/v22.09.5-edge.mdx new file mode 100644 index 000000000..dbdf4888c --- /dev/null +++ b/changelog/nextflow/v22.09.5-edge.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v22.09.5-edge +date: 2022-09-21 +tags: [nextflow] +--- + +- Use default wave strategy [abbfa7f4] +- Handle errors reported by tower report writer [0e814647] +- Fix AWS S3 copy object [b3b90d23] diff --git a/changelog/nextflow/v22.09.6-edge.mdx b/changelog/nextflow/v22.09.6-edge.mdx new file mode 100644 index 000000000..d69e53299 --- /dev/null +++ b/changelog/nextflow/v22.09.6-edge.mdx @@ -0,0 +1,15 @@ +--- +title: Nextflow v22.09.6-edge +date: 2022-09-26 +tags: [nextflow] +--- + +- Add SocketTimeoutException to k8s client request retry [527e0d5d] +- Add MaxErrorRetry to K8s config [58be2128] +- Add tags propagation to AWS Batch [d64eeffc] +- Fix task resume when updating fusion layer [f38fd2db] +- Fix Channel merge still deprecated for DSL2 (#3220) [d27384d2] +- Apply GCP resourceLabels to the VirtualMachine (#3234) [2275c03c] +- Update Google Batch mount point with the requirements [5aec28ac] +- Improve wave error reporting [73842215] +- Bump fusion 0.4.x [26f1f896] diff --git a/changelog/nextflow/v22.09.7-edge.mdx b/changelog/nextflow/v22.09.7-edge.mdx new file mode 100644 index 000000000..bfcd289f8 --- /dev/null +++ b/changelog/nextflow/v22.09.7-edge.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v22.09.7-edge +date: 2022-09-28 +tags: [nextflow] +--- + +- Fix Issue copying file bigger than 5gb to S3 [18fd9a44] +- Fix chmod command to accommodate hidden files in bindir (or empty bindir) (#3247) [a0fcc7b0] +- Bump nf-amazon@1.10.7 [f7f96e6f] diff --git a/changelog/nextflow/v22.10.0-RC1.mdx b/changelog/nextflow/v22.10.0-RC1.mdx new file mode 100644 index 000000000..c24f158aa --- /dev/null +++ b/changelog/nextflow/v22.10.0-RC1.mdx @@ -0,0 +1,27 @@ +--- +title: Nextflow v22.10.0-RC1 +date: 2022-10-03 +tags: [nextflow] +--- + +- Add module binaries enabling flag + docs [c50e178f] +- Add timestamp and fingerprint to wave request [a5a7e138] +- Add missing inputs to the incremental task "test" (#1442) [ci fast] [f85d59a6] +- Add support for refresh token to Wave [ed9f25f1] +- Add pretty option to dump operator [ci fast] [4218b299] +- Add support for custom S3 content type [02afa332] +- Get rid of file name rolling for report files [a762ed59] +- Ignore JGit warning when missing git tool [a94fa9c1] +- Remove jobname limit to HyperQueue executor (#3251) [99604ccb] +- Rename baseImage to mambaImage [ci fast] [50086028] +- Fix failing test [ci fast] [e6790003] +- Fix K8s cluster token when using serviceAccount [c3364d0f] +- Fix hanging test [44c04874] +- Improve docs (#3212) [ci skip] [5d80388c] +- Bump fusion snapshot [ci skip] [8e03f655] +- Bump wave endpoint [a044cc6a] +- Bump nf-wave@0.4.5 [7424dc4b] +- Bump fusion config v0.5.1 [4dbdf112] +- Bump nf-wave@0.5.0 +- Bump nf-tower@1.5.5 +- Bump nf-amazon@1.11.0 diff --git a/changelog/nextflow/v22.10.0-RC2.mdx b/changelog/nextflow/v22.10.0-RC2.mdx new file mode 100644 index 000000000..2f1b5818a --- /dev/null +++ b/changelog/nextflow/v22.10.0-RC2.mdx @@ -0,0 +1,11 @@ +--- +title: Nextflow v22.10.0-RC2 +date: 2022-10-07 +tags: [nextflow] +--- + +22.10.0-RC2 - 7 Oct 2022 +- Improve K8s labels/annotation validation [a569afdf] +- Bump fusion final URL [80398880] +- Bump nf-wave@0.5.1 [a2b44c4d] +- Update docs diff --git a/changelog/nextflow/v22.10.0-RC3.mdx b/changelog/nextflow/v22.10.0-RC3.mdx new file mode 100644 index 000000000..75006f64c --- /dev/null +++ b/changelog/nextflow/v22.10.0-RC3.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v22.10.0-RC3 +date: 2022-10-07 +tags: [nextflow] +--- + +- Fix K8s context selection [58b354e6] diff --git a/changelog/nextflow/v22.10.0.mdx b/changelog/nextflow/v22.10.0.mdx new file mode 100644 index 000000000..d2fcfa346 --- /dev/null +++ b/changelog/nextflow/v22.10.0.mdx @@ -0,0 +1,283 @@ +--- +title: Nextflow v22.10.0 +date: 2022-10-13 +tags: [nextflow] +--- + +- Fix timestamp encoding [47a3a3c4] +- Minor type change in Bridge executor [1f446ee1] +- Bump nf-wave@0.5.2 [326803ff] + +Included in previous RC and edge releases: + +22.10.0-RC3 - 7 Oct 2022 +- Fix K8s context selection [58b354e6] + +22.10.0-RC2 - 7 Oct 2022 +- Improve K8s labels/annotation validation [a569afdf] +- Bump fusion final url [80398880] +- Bump nf-wave@0.5.1 [a2b44c4d] +- Update docs + +22.10.0-RC1 - 3 Oct 2022 +- Add module binaries enabling flag + docs [c50e178f] +- Add timestamp and fingerprint to wave request [a5a7e138] +- Add missing inputs to the incremental task "test" (#1442) [ci fast] [f85d59a6] +- Add support for refresh token to Wave [ed9f25f1] +- Add pretty option to dump operator [ci fast] [4218b299] +- Add support for custom S3 content type [02afa332] +- Get rid of file name rolling for report files [a762ed59] +- Ignore JGit warning when missing git tool [a94fa9c1] +- Remove jobname limit to HyperQueue executor (#3251) [99604ccb] +- Rename baseImage to mambaImage [ci fast] [50086028] +- Fix failing test [ci fast] [e6790003] +- Fix K8s cluster token when using serviceAccount [c3364d0f] +- Fix hanging test [44c04874] +- Improve docs (#3212) [ci skip] [5d80388c] +- Bump fusion snapshot [ci skip] [8e03f655] +- Bump wave endpoint [a044cc6a] +- Bump nf-wave@0.4.5 [7424dc4b] +- Bump fusion config v0.5.1 [4dbdf112] +- Bump nf-wave@0.5.0 +- Bump nf-tower@1.5.5 +- Bump nf-amazon@1.11.0 + +22.09.7-edge - 28 Sep 2022 +- Fix Issue copying file bigger than 5gb to S3 [18fd9a44] +- Fix chmod command to accommodate hidden files in bindir (or empty bindir) (#3247) [a0fcc7b0] +- Bump nf-amazon@1.10.7 [f7f96e6f] + +22.09.6-edge - 26 Sep 2022 +- Add SocketTimeoutException to k8s client request retry [527e0d5d] +- Add MaxErrorRetry to K8s config [58be2128] +- Add tags propagation to AWS Batch [d64eeffc] +- Fix task resume when updating fusion layer [f38fd2db] +- Fix Channel merge still deprecated for DSL2 (#3220) [d27384d2] +- Apply GCP resourceLabels to the VirtualMachine (#3234) [2275c03c] +- Update Google Batch mount point with the requirements [5aec28ac] +- Improve wave error reporting [73842215] +- Bump fusion 0.4.x [26f1f896] + +22.09.5-edge - 21 Sep 2022 +- Use default wave strategy [abbfa7f4] +- Handle errors reported by tower report writer [0e814647] +- Fix AWS S3 copy object [b3b90d23] + +22.09.4-edge - 19 Sep 2022 +- Add Fusion display name [f789d457] +- Add container cleanup [cd2ae7dc] +- Add Wave interactive debug session [ce7fa651] +- Add support for wave build and cache repositories[692043ff] +- Add shutdown to Google Batch client [8f413cf7] +- Add native_id to Google Batch handler [352b4239] +- Add java sts library to enable use of IRSA in k8s (#3207) [62df42c3] +- Add support for module custon bin dirs [77f55262] +- Add support for tower token to wave client [928d5b04] +- Update CLI docs (#3200) [8acebee6] +- Fix issue with empty report file [9cc4f079] +- Do not return resource bundle for root module [775c7ed9] +- Improve tower config [ee03c243] +- Bump groovy 3.0.13 [4a17e198] + +22.09.3-edge - 10 Sep 2022 +- Add fusion support to K8s executor (#3142) [6bb27b32] +- Fix shutdown/cleanup hooks invocation [f4185070] +- Fix Use smaller buffer size for S3 stream uploader [8c643074] [9926d15d] +- Fix Azure NPE on missing pool opts [d5c0aabd] +- Fix handling of targetDir when using Fusion fs [2091b272] +- Document aws.batch.retryMode config (#3195) [56f75e0c] + +22.09.2-edge - 7 Sep 2022 +- Fix thread pool race condition on shutdown [8d2b0587] +- Fix Intermediate multipart upload requires a minimum size (#3193) [0b66aed6] +- Fix fusion enable detection [3ef91512] +- Add before-afterScript warning to docs (#3167) [09464590] +- Add httpReadTimeout and httpConnectTimeout config to K8s client [064f9bc4] +- Add support for Wave build & cache repos [98a275ba] +- Finalise secrets feature (#3161) [49021b82] +- Update executor retry config docs (#3001) [aed6c234] +- Change Azure test pool name [0c724504] +- Improve Wave error reporting [b11d0f11] +- Remove unneeded launcher file remapping [a255118d] +- Update Azure vm types [80f5fbe4] +- Update docs logos (#3174) [529bad81] + +22.09.1-edge - 1 Sep 2022 +- Add support for Charliecloud v0.28 (#3116) [84f43a33] +- Add Support for EC-encrypted keys for K8s client [fd759d09] +- Add support for Bridge batch scheduler (#3106) [343c17e6] +- Add fusion support to local executor [17160bb0] [6cfb51e7] +- Add getTags and getBranches to BitBucketServer [53bd89cd] +- Add retry strategy to httpfs client [55f9c87b] +- Add support for project resources [c2ad6566] +- Add mamba build options [987a13cb] +- Fix Do not override tower endpoint in the config [41fb1ad0] +- Fix Hyperqueue job names must be less than 40 chars #3151 [8e43670b] +- Fix typo in ConfigBuilder.groovy (#3143) [659e6108] +- Fix Resume for dynamic resolved containers [13483ff2] +- Improve fusion env handling [10f35b60] +- Improve foreign file(s) cache detection logic [3a9352c8] +- Rename ModuleBundle to ResourcesBundle [0e51dc0f] +- Use quiet output mode for hyperqueue executor (#3103) [70a91fdf] +- Wave improve conda settings [6f087fec] +- Improve secrets cmd (#3158) [115b2f3d] +- Improve Wave resolution strategy [2eb700c6] +- Improve Az Batch err handling and testing [85d31e8d] +- Bump google-cloud-batch 0.2.2 +- Bump spock 2.2 + +22.08.2-edge - 16 Aug 2022 +- Fix queueSize setting is not honoured by AWS Batch executor (again) #3117 [1733bb2e] +- Add `files()` method to docs (#3123) [00bb8896] +- Refactor wave packing [bc876986] +- Improve logging [aa380d5f] +- Update dockerfile [e6329282] + +22.08.1-edge - 11 Aug 2022 +- Add support for disabling config include [e0859a12] +- Add experimental fusion support [1854f1f2] +- Add support for plugin provided function extension (#3079) [16230c2b] +- Add support for AWS Batch logs group (#3092) [4ef043ac] +- Add share identifier to Aws Batch (#3089) [c0253aba] +- Improve Tower cache manager [0091afc5] +- Improve S3 copy via xfer manager [02d2beae] +- Reports a warning when using NXF vars in the config [009ec256] +- Make wake token cache duration config [5f955fc9] +- Patch unable to start non-core plugin [a55f58ff] +- Increase S3 upload chunk size to 100 MB [9c94a080] +- Change Google Batch disk directive to override boot disk size (#3097) [7e1c0686] +- Fix queueSize setting is not honoured by AWS Batch executor (#3093) [d07bb52b] +- Fix Allow disabling scratch with Google Batch [e8e5c721] +- Fix Emit relative path when relative parameter is set (#3072) [39797759] +- Bump nf-wave@0.3.0 [e46d341d] +- Bump nf-tower@1.5.1 [cdc2be53] +- Bump nf-google@1.4.1 [c39935a5] +- Bump nf-amazon@1.10.0 [ccdf62d0] + +22.08.0-edge - 1 Aug 2022 +- Add warning to env config docs (#3083) [ca933c16] +- Add -with-conda CLI option (#3073) [98b2ac80] +- Add simple wave plugin cli commands [8888b866] +- Add default wave plugin [7793a0ec] +- Add boot disk, cpu platform to google batch (#3058) [17a8483d] +- Add support for GPU accelerator to Google Batch (#3056) [f34ad7f6] +- Add support for archive dir to tower plugin [c234681a] +- Add support tower cache backup/restore [bc2f9d13] +- Add disk directive to google batch (#3057) [ec6e290c] +- Add retry when Azure submit fails with OperationTimedOut [6a3f9742] +- Add warning when Google Batch quota is exceeded (#3066) [6b9c52ad] +- Allow fully disabling history file [0a45f858] +- Allow the support function overloading and default parameters (#3011) [042d3857] +- Improve S3 file upload/download via Transfer manager [7e8d2a5a] +- Prevent overriding container entrypoint [b3a4bf85] +- Update FileTransfer pool settings [503aafce] +- Remove deprecated commands [93228b4b] +- Prevent nextflow config to break tower launch [e059a724] +- Refactor Google Batch executor to use Java API (#3044) [31a6e85c] +- Fix Unable to disable scratch attribute with AWS Batch [1770f73a] +- Fix unit test setting explicit permissions for test files [1c821139] +- Fix Default plugins are overriden by config plugins [46cf3bfa] +- Fix S3 transfer download directory [b7bf9fe5] +- Fix NPE while setting S3 ObjectMetada #3031 [d6163431] +- Fix Unable to retrieve AWS batch instance type #1658 [3c4d4d3b] +- Fix AWS Batch job definition conflict (#3048) [e5084418] +- Fix JAVA_TOOL_OPTIONS breaking launch #1716 [0e7b416d] +- Fix add ps shared objects to Dockerfile (#3033) [1c23b40a] +- Parallelize build integration tests [807800a3] +- Bump google-cloud-nio:0.124.8 [dfaa9d19] +- Bump groovy 3.0.12 [5c900b91] +- Bump Moment.js 2.29.4 [a9ced868] +- Bump gson@2.9.0 [12f17176] +- Bump nf-azure@0.13.4 +- Bump nf-google@1.4.0 +- Bump nf-tower@1.5.0 +- Bump nf-wave@0.2.1 +- Bump nf-amazon@1.9.0 + +22.07.1-edge - 13 Jul 2022 +- Add support for Google Batch API v1 [4c116d58] [e85d87ee] +- Add time directive support for K8s executor (#2948) [2b6f70a8] +- Add docs aws.client.s3PathStyleAccess config (#3000) [20005500] +- Allow to override lsf.conf settings with nextflow config #2862 [dae191a1] +- Allow hybrid containers execution [0af1bcb3] +- Improve error msg when script file cannot be read [52c2780e] +- Improve error reporting for custom function [877c7931] +- Improve error message for missing plugin extension [4a43db84] +- Improve test #3019 [7c37e0be] +- Rename kuberun -pod-image to -head-image [2576ba62] +- Externalise sqldb plugin source code [17e80b4f] +- Fix escape unstage outputs with double quotes #2912 #2904 #2790 [49ff02a6] +- Fix Exception when settings AWS Batch containerOptions #3019 [89312ad8] +- Fix Missing query param in http file (#2918) [43cc8511] +- Fix Publish copy mode for S3 based path [085f6b2b] +- Fix Fail fast uploads to S3 (#2969) [7fd1a6e1] +- Fix null script name in launch info [7118849f] +- Bump commons-code@1.15 [a06b4442] +- Bump jgit@6.2.0 [3331826f] +- Bump snakeyaml@1.30 [de62fd3f] +- Bump gson@2.8.9 [3234ddd5] + +22.07.0-edge - [SKIPPED] + + +22.06.1-edge - 17 Jun 2022 +- Fix CodeCommit creds handling + nf-codecommit@0.1.2 [70fc0745] +- Fix typo in log message [a8f8529d] +- Add more scientists to the list of random names [8d5b36a2] + +22.06.0-edge - 9 Jun 2022 +- Add AWS CodeCommit initial support [80fba6e9] +- Add support for 307 and 308 HTTP redirection [92382012] +- Add DirWatcher v2 [209c82cd] +- Add Moriondo in the list of random names [e0abca58] +- Add preview CLI option (#2914) [aa8f1aa4] +- Fix Git config resultion error [64436697] +- Fix StackOverflowError when dump all profiles (#2922) [28cd11a2] +- Fix gradle warning message in nf-sqldb (#2921) [b09ceabe] +- Fix log for LsfExecutror perTaskReserve attribute [7c3ec874] +- Fix external pod deletion for jobs (#2915) [4dd1af7a] +- Prevent function overloading in module definition [c0b522ab] +- Improve error message of non sensical include (#2623) [285fe49c] +- Mount PWD path only when scratch is used [9b3c6e31] +- Stripe sensitive data into strings (#2908) [7fa4c86c] +- Dump scm content when trace is enabled [c3117ada] + +22.05.0-edge 25 May 2022 +- Add Hyperqueue executor (#2896) [ffa5712e] +- Add support for K8s Job resource [c70eb12d] +- Add support for time process directive in GLS executor (#2880) [1402e183] +- Add support for priviledge option for K8s containers [7ffe3a02] +- Add DSL1 option to docs (#2836) [d30841a5] +- Add support for container options to Azure Batch [3f4f00f9] +- Add support for move operation to AWS S3 [8c0ddfd5] +- Add K8s execution hostname in the trace file (#2828) [ebaef92a] +- Add support for AWS S3 encyption using a custom KMS key [c1e45aa9] +- Add support for Micromamba [383e023f] +- Add jaxb-api dependecy to nf-amazon [c1a09f87] +- Add strict mode config setting [ci fast] [696e70b5] +- Add -head-prescript option to kuberun (#2830) [9e387055] +- Fix missing err message on submit failure [233e67f0] (#2899) +- Fix resolve azure devops repositories when projectId is present [2500ff01] +- Fix AthenaJdbc into distribution zip [853a1f2a] [4b3579d5] [70ef7ee3] +- Fix Inconsistent bool parsing #2881 [40bf2b2a] +- Fix Unable to pull pipeline if config file is not in default branch (#2876) [4ee5b04f] +- Fix Prevent crash when scratch dir does not exist (#2888) [9ef44ae5] +- Fix DSL1 detection to invalid workflow keyword matching [fe0700b0] (#2879) +- Fix Aws Batch retry policy on spot reclaim [6e029b79] +- Fix 'false' string in config interpreted as true (#2865) [079a18ce] +- Improve Git Provider config logging [d7dbca8ec] +- Improve K8s task handler [1822b2ca] +- Improve missing workflow err message [da101e8f] (#2871) +- Include revision in the Azure Repos provider when specified (#2861) [3342c767] +- Remove unnecessary change dir echo [372d1f47] +- Abort execution when accessing undefined params with strict mode [93836081] +- Update docker base image [50cd7956] +- Update default SKU for Azure Batch (#2868) [9ea09dba] ] +- Update dependencies [405d9545] +- Refactoring to prevent name conflict [aba2671b] +- Few DSL syntax to explicit declaration of plugin extensions (#2820) [bfc4a067] +- Sanitize k8s label and annotation keys, don't sanitize annotation value (#2843) [5287a984] +- Docs improvement (#2835) [09e5bca3] +- Bump Jgit 6.1 [7186348c] +- Bump Spock 2.1 [51100d16] +- Bump capsule 1.1.1 [20ec1697] diff --git a/changelog/nextflow/v22.10.1.mdx b/changelog/nextflow/v22.10.1.mdx new file mode 100644 index 000000000..da87b8164 --- /dev/null +++ b/changelog/nextflow/v22.10.1.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v22.10.1 +date: 2022-10-27 +tags: [nextflow] +--- + +- Fix mount pwd in the container when work dir is a symlink [ca397181] [b5b7d3cd] +- Fix secrets command name in the CLI (#3320) [ci fast] [321486df] +- Fix ver num rendering [ci fast] #3226 [5312a25e] +- Fix K8s config namespace is not applied [b3d33e3b] +- Fix log fetching from remote storage [be356939] [3efa1a20] +- Update docs about default mail ssl protocol [ci skip] (#3299) [15ffffc1] +- Update docs repeated words from documentation (#3311) [ci skip] [d59ea186] +- Update docs to clarify the difference between collect and toList (#3276) [7ee2b008] +- Update docs [516a7441] +- Update docs adding Fusion [11eac707] diff --git a/changelog/nextflow/v22.10.2.mdx b/changelog/nextflow/v22.10.2.mdx new file mode 100644 index 000000000..386c90f8c --- /dev/null +++ b/changelog/nextflow/v22.10.2.mdx @@ -0,0 +1,21 @@ +--- +title: Nextflow v22.10.2 +date: 2022-11-13 +tags: [nextflow] +--- + +- Fix initialize the plugin once it's defined (#3360) [dd150b92] +- Fix tags typo in docs (#3355) [b82df4e0] +- Fix unexpected error on task resume [e02e8c27] +- Fix template script in trace record [cf828a68] +- Fix ip v6 support for K8s executor [53af5a7c] +- Fix refresh token for tower served resources [9dec2b66] #3366 +- Fix full path scheme on error [1399f451] +- Add note to some process implicit variables (#3373) [0374f63a] +- Add retry policy on plugin download failure [e8dbec3f] +- Add examples of when dynamic output filenames are important (#3275) [72a17306] +- Update google batch java sdk, add serviceAccountEmail and installGpuDrivers (#3324) [7f7007a8] +- Update github actions to v3 (#3376) [d3b4a837] +- Update error messages and docs with new report filename behavior [f5725480] +- Bump nf-tower@1.5.6 [164edf7c] +- Bump nf-google@1.4.5 [30cb118d] diff --git a/changelog/nextflow/v22.10.3.mdx b/changelog/nextflow/v22.10.3.mdx new file mode 100644 index 000000000..531df9adb --- /dev/null +++ b/changelog/nextflow/v22.10.3.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v22.10.3 +date: 2022-11-21 +tags: [nextflow] +--- + +- Prevent infinite loop while fetching git tags/branches [73a59d33] +- Bump nf-amazon@1.11.1 [f9b54ce3] +- Improve S3 thread pool config [01541b0a] diff --git a/changelog/nextflow/v22.10.4.mdx b/changelog/nextflow/v22.10.4.mdx new file mode 100644 index 000000000..7fa66420c --- /dev/null +++ b/changelog/nextflow/v22.10.4.mdx @@ -0,0 +1,8 @@ +--- +title: Nextflow v22.10.4 +date: 2022-12-09 +tags: [nextflow] +--- + +- Fix math overflow when copying large AWS S3 files [07f7cb72] +- Bump nf-amazon@1.11.2 [d96ca4c3] diff --git a/changelog/nextflow/v22.10.5.mdx b/changelog/nextflow/v22.10.5.mdx new file mode 100644 index 000000000..1e1b3aab2 --- /dev/null +++ b/changelog/nextflow/v22.10.5.mdx @@ -0,0 +1,9 @@ +--- +title: Nextflow v22.10.5 +date: 2023-01-14 +tags: [nextflow] +--- + +- Fix FilePorter concurrency issue (#3511) [0f757156] +- Fix watchPath hang shutdown execution [e03d9ca6] +- Add `schedulingPriority` option to AWS Batch (use with `shareIdentifier`) (#3505) [543ee7b1] diff --git a/changelog/nextflow/v22.10.6.mdx b/changelog/nextflow/v22.10.6.mdx new file mode 100644 index 000000000..57ed61b8b --- /dev/null +++ b/changelog/nextflow/v22.10.6.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v22.10.6 +date: 2023-01-23 +tags: [nextflow] +--- + +- backport: Add refresh token to wave request [47a7408b] +- backport:Add tower endpoint to wave [fe24b422] +- backport:Fix Wave layer invalid checksum due to not closed stream [20df6400] +- Bump nf-wave@0.5.3 [c1ec759f] diff --git a/changelog/nextflow/v22.10.7.mdx b/changelog/nextflow/v22.10.7.mdx new file mode 100644 index 000000000..b5ea44a8c --- /dev/null +++ b/changelog/nextflow/v22.10.7.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v22.10.7 +date: 2023-02-18 +tags: [nextflow] +--- + +- Fix plugin install version [895e4f34] +- Fix unique fingerprint for wave bundle resources [7c55aa37] +- Fix race condition on wave requests [7f76d19b] +- Fix serialization of S3 paths with spaces (#3565) [935df949] +- Improve AWS batch error logging [1eddeea7] +- Improve wave logging [94415914] +- Increase Wave token duration to 30 mins [8d5fbefe] +- Update fusion docs [b24ee138] +- Bump nf-wave@0.5.4 [f466b266] +- Bump nf-amazon@1.11.4 [d5f6c125] diff --git a/changelog/nextflow/v22.10.8.mdx b/changelog/nextflow/v22.10.8.mdx new file mode 100644 index 000000000..3fb155b69 --- /dev/null +++ b/changelog/nextflow/v22.10.8.mdx @@ -0,0 +1,17 @@ +--- +title: Nextflow v22.10.8 +date: 2023-04-15 +tags: [nextflow] +--- + +- Security fixes [fc2627bb] +- Add support for testing custom plugin uri [718d4562] +- Improve plugin updater err handling [84042082] +- Improve plugin test detection [ci fast] [e6c60a6c] +- Bump nf-google@1.4.6 [26b01b83] +- Bump nf-wave@0.5.5 [2a886fe0] +- Bump nf-ga4gh@1.0.5 [b8769f1a] +- Bump nf-tower@1.5.7-patch0 [89d902ec] +- Bump nf-azure@0.14.3 [9b0f4bfb] +- Bump nf-amazon@1.11.5 [f7aaddc6] +- Bump amazoncorretto@17.0.6 [7898cc04] diff --git a/changelog/nextflow/v22.11.0-edge.mdx b/changelog/nextflow/v22.11.0-edge.mdx new file mode 100644 index 000000000..237de152d --- /dev/null +++ b/changelog/nextflow/v22.11.0-edge.mdx @@ -0,0 +1,35 @@ +--- +title: Nextflow v22.11.0-edge +date: 2022-11-23 +tags: [nextflow] +--- + +- Add support for Apptainer container engine (#3345) [29f98975] +- Add Flux executor to nextflow (#3412) [cc9fc3f0] [3711cef0] +- Add support for Wave containerPlatform [10d56ca1] +- Add CSI ephemeral volume for K8s (#2988) [f18f6e81] +- Add support for disk directive and emptyDir to K8s (#2998) [b548e1c7] +- Add Fusion support for custom S3 endpoints [fba9b649] +- Add support for Tower refresh token for dataset (#3366) [a19e055a] +- Prevent infinite loop while fetching git tags and branches [aa974d44] +- Improve file porter logging [626420b6] +- Improve script err logging [2714770e] +- Extend onFilePublish notification adding source path (#3284) [81acc3ef] +- Remove cpu limits from K8s pod spec builder (#3338) [dc7f78bf] +- Improve task name logging [5ddb7e3f] +- Add tower endpoint to wave [ci fast] [b725ddc4] +- Add Azure SAS token validation [e2244b48] +- Use cpus-shares for container resources (#3383) [b38c3880] +- Report full path scheme on error [4089ba65] +- Allow identity based authentication on Azure Batch (#3132) [a08611be] +- Fix support for remote file mail attachment (#3384) [6b496bb9] +- Fix task cache logging [ed37c4fd] +- Fix unexpected error on task resume [1c3f4685] +- Fix stripIndent failure with java 17 (#3377) [2b115c50] +- Fix -dockerized execution #3137 (#3148) [64a81a58] +- Improve default value in cli help of `nextflow log -s` (#3371) [2141f96e] +- upgrade jsoup and snakeyaml version (#3374) [6e2ca454] +- Bump Java 17 lang version + Java 11 as target [34f133e2] +- Bump nf-amazon@1.12.0 [e307912e] +- Bump nf-azure@0.15.0 [07391d96] +- Bump nf-wave@0.6.0 [4d787561] diff --git a/changelog/nextflow/v22.11.1-edge.mdx b/changelog/nextflow/v22.11.1-edge.mdx new file mode 100644 index 000000000..19208bc3c --- /dev/null +++ b/changelog/nextflow/v22.11.1-edge.mdx @@ -0,0 +1,16 @@ +--- +title: Nextflow v22.11.1-edge +date: 2022-11-29 +tags: [nextflow] +--- + +- Fix TowerArchiver resolve envar paths relative to baseDir (#3438) [53e6348c] +- Fix tower plugin min nextflow requirement [103dbf74] +- Fix typos in the documentation [ci skip] (#3441) [ae95d90d] +- Add support for Java 19 [811e7ca8] +- Add support for custom Conda channels (#3435) [ci fast] [0884e80e] +- Add time directive to AWS Batch, clean language (#3436) [ci skip] [1ed2640a] +- Update err message [ci fast] [ab5bd81b] +- Fix Flux executor config (#3432) [ci fast] [68b45c92] +- Bump nf-wave@0.6.1 [fe669152] +- Bump nf-tower@1.5.7 [2dbf9906] diff --git a/changelog/nextflow/v22.12.0-edge.mdx b/changelog/nextflow/v22.12.0-edge.mdx new file mode 100644 index 000000000..176698232 --- /dev/null +++ b/changelog/nextflow/v22.12.0-edge.mdx @@ -0,0 +1,48 @@ +--- +title: Nextflow v22.12.0-edge +date: 2022-12-13 +tags: [nextflow] +--- + +- Add `fair` process directive [60d34cfd] +- Add support for singularity registry setting [37c1aeb9] +- Add AWS profile config setting [66f4669f] +- Add support for AWS profile when resolving region [d8947707] +- Add support for Sarus container engine (#3470) [54673f18] +- Add support for Fusion ARM64 client [d073c538] +- Add `allowedLocations` option to google batch (#3453) [c619eb81] +- Add support for AWS config profile in NF config [37112672] +- Add warning on Google Logs failure [bdbcdde9] +- Add possible values of `status` in `trace.txt` to the documentation (#3451) [2425fcfb] +- Add support for AWS Glacier restore [b6110766] +- Add support for S3 `storageClass` to `publishDir` [066f9203] +- Add MathHelper utility class [7eecb266] +- Fix Wave layer invalid checksum due to not closed stream [e188bbf9] +- Fix Fusion test [2245a1c7] +- Fix Run fails when home is a symlink [9ff820f4] +- Fix math overflow when copying large AWS S3 files [f32ea0ba] +- Fix Quote the logName in the Cloud Logging filter (#3464) [b3975063] +- Fix Google Batch cloud logging (#3443) [e2bbcf15] +- Fix Tower plugin min nextflow requirement [1713a1cd] +- Fix TowerArchiver resolve envar paths relative to baseDir (#3438) [46af18e5] +- Error & info messages, code comments language fixes (#3475) [29ae36ca] +- Replace `egrep` with `grep -E` (#3485) [ac0c3035] +- Gradle build optimizations (#3483) [19182a57] +- Refactor virtual FS schemes to XPath class [fd59b943] +- Update concat operator description (#3426) [e8d8c3b5] +- Clarify usage of additional options for path qualifier (#3405) [0b70acb1] +- Clarify limitation of `-with-docker` in the docs (#3408) [79afc85d] +- Expose process queue as K8s pod label [4df8c8d2] +- Prefix nextflow K8s labels with `nextflow.io` prefix [9951fcd9] +- Remove deprecated code [c0b164f2] +- Rewrite fetchIamRole and fetchRegion to use AWS SDK (#3425) [e350f319] +- Improve Wave config error reporting [ae502668] +- Improve K8s retry on transient failures [d86ddc36] +- Remove DSL1 output mode [fa400d5f] +- Remove support for DSL1 multi into [f664af45] +- Bump nf-amazon@1.13.0 [ccaab713] +- Bump nf-google@1.5.0 [c07dcec2] +- Bump nf-wave@0.6.3 +- Bump nf-tower@1.5.8 [652d0880] +- Bump fusion version URLs 0.6 [a160a8b1] +- Bump AWS sdk version 1.12.351 [4dd82b66] diff --git a/changelog/nextflow/v23.01.0-edge.mdx b/changelog/nextflow/v23.01.0-edge.mdx new file mode 100644 index 000000000..24370d8ec --- /dev/null +++ b/changelog/nextflow/v23.01.0-edge.mdx @@ -0,0 +1,43 @@ +--- +title: Nextflow v23.01.0-edge +date: 2023-01-14 +tags: [nextflow] +--- + +- Add support for rclone as stageOutMode option [fde2ac27] +- Add queueGlobalStatus config setting [ci fast] [f3339541] +- Add support for bearer token to GithubRepositoryProvider [c4d39384] [a2d2cbf60] +- Add -with-fusion cli option [d22337cd] +- Add support for Fusion container custom options [56e29d35] +- Add `schedulingPriority` option to AWS Batch (use with `shareIdentifier`) (#3505) [06960bb2] +- Fix support for AWS ACL for Batch #2671 [a9644919] +- Fix Java options.release in Gradle build [b362d6f6] +- Fix nf-httpfs module name in build file [568e47f6] +- Fix GitHub creds in CI build [4c4d3f81] +- Fix FilePorter concurrency issue (#3511) [11ccfa26] +- Fix watchPath hang shutdown execution [bac0cedf] +- Fix "no such file" error message to "no such file or directory" [ci fast] (#3547) [c292d84e] +- Improve local exec workdir validation [4a3a2720] +- Improve container native executor configuration [03126371] +- Improve AWS batch exit code reporting [d1bb2fe2] +- Improve channel factories error message [0215b9fc] +- Improve Google Batch executor [c0a25fc2] +- Improve Fusion config [902e5b34] [52f4c5d5] +- Improve redirection on Wave client [124cfb3e] +- Remove unnecessary Fusion env var [ci fast] [dfa47556] +- Remove deprecated method 'just' [d17b3c46] +- Remove deprecated methods [75e65035] +- Remove DSL1 deprecated code [5d290a47] +- Cleanup build from tmp manifests [326b3839] +- Minor compilation improvements [4188a6ac] +- Migrate all tests to DSL2 [14257d49] +- Bump 23.01.0-edge version [9ec31444] +- Bump groovy 3.0.14 [7c204236] [6f3ed6e8] +- Bump Grengine 3.0 [c0b1a7a6] +- Bump nf-wave@0.7.0 [45d274e3] +- Bump nf-tower@1.5.9 [db0ebe72] +- Bump nf-google@1.6.0 [a663fe16] +- Bump nf-console@1.0.5 [45fd53ad] +- Bump nf-codecommit@0.1.3 [cf39ef8f] +- Bump nf-azure@0.15.1 [7a6a78aa] +- Bump nf-amazon@1.14.0 [41fdcc72] diff --git a/changelog/nextflow/v23.02.0-edge.mdx b/changelog/nextflow/v23.02.0-edge.mdx new file mode 100644 index 000000000..8ab0e8046 --- /dev/null +++ b/changelog/nextflow/v23.02.0-edge.mdx @@ -0,0 +1,65 @@ +--- +title: Nextflow v23.02.0-edge +date: 2023-02-21 +tags: [nextflow] +--- + +- Add Fusion support for Google Batch (#3577) [d5fbab4f] +- Add Header provider to Google Batch client [20979929] +- Add Wave integration tests [c5faf971] +- Add errorStrategy validation [954cd921] +- Add Java install recommendations to docs (#3617) [7e9bee1e] +- Add nextflow tags to AWS Batch job def [b465ac52] [BREAKING] +- Add readOnlyInputs option for CharliecloudBuilder (#3590) [8ae001fc] +- Add refresh token to Wave request [41510e87] +- Add requirements for container images to run with Nextflow (#3586) [7af1cb66] +- Add support for Fusion to Slurm and LSF executors (#3516) [fbc95e6b] +- Add support for Fusion tags (#3609) [8385ec22] +- Add support for the Spack package manager (#3580) [a5df62f6] +- Add the fcp tool option to file copy strategy (#3556) [2a224258] +- Add Fusion integration test +- Add Wave + Fusion test with Google Batch [b541c061] +- Add support for entryless Fusion configuration and Singularity support (#3584) [34a27733] +- Improve Fusion config [a1d08463] +- Ignore resource directives if -l option is specified in PBS executor (#3015) [28a67969] +- Improve K8s securityContext support [3f76240b] +- Improve AWS Batch error logging [8f4884c1] +- Improve secrets docs [9a3b4214] +- Improve Wave debug-task plugin command [cf3fd747] +- Improve Wave logging [fced3761] +- Increase Wave token duration to 30 mins [e1a712c2] +- Fix -with-apptainer cli option (#3621) [8c9588fe] +- Fix GH action tests step [bb890d9a] +- Fix Spack failing test [868374d3] +- Fix Tower doc links, fix typos (#3647) [1278e1a5] +- Fix Wave cli messages [10cf414b] +- Fix collectFile cache over remote storage [762ba19c] +- Fix output env var tokenize [40d56735] +- Fix plugin install version [59e9a91b] +- Fix race condition on Wave requests [f57fae2c] +- Fix serialization of S3 paths with spaces (#3565) [ce487624] +- Fix string literal method names with parens (#3604) [8278078a] +- Fix submit command in error message for grid executors that pipe wrapper script (#3548) [40ebd308] +- Fix typos in the documentation [skip ci] (#3640) [eccc1130] +- Fix unique fingerprint for Wave bundle resources [b59fa728] +- Log exception when an unexpected occurs (#3603) [9aeca99f] +- Minor change on container resolution [23d47ded] +- Refactor httpfs configuration [445218a8] +- Remove deprecated buckets field [0a355ac3] +- Remove leading/trailing special chars from tag [7d3cc707] +- Remove unused `-with-k8s` CLI option (#3624) [85b6e7d3] +- Update config.rst (#3655) [1555e188] +- Update Fusion docs [12782eeb] +- Bump Fusion 2.1 [f48ef5b3] +- Bump Groovy 3.0.15 [7a3ebc7d] +- Bump Micromamba 1.3.1 [aa2bf37e] +- Bump Spock 2.3 [9f0dac31] +- Bump nf-wave@0.7.1 [b797fac2] +- Bump nf-tower@1.5.10 [dd2f69dd] +- Bump nf-google@1.7.0 [8cb9fa35] +- Bump nf-amazon@1.15.0 [7ccca430] + +## Breaking changes + +- Using the AWS Batch executor, Nextflow requires the permission `batch:TagResource` when creating Batch job permissions +- Using the AWS Batch executor with Fusion file system, Nextflow requires `s3:PutObjectTagging` permission on the S3 objects created by job executions diff --git a/changelog/nextflow/v23.02.1-edge.mdx b/changelog/nextflow/v23.02.1-edge.mdx new file mode 100644 index 000000000..71ddebd12 --- /dev/null +++ b/changelog/nextflow/v23.02.1-edge.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v23.02.1-edge +date: 2023-02-26 +tags: [nextflow] +--- + +- Add Fusion logs and tags config [09192078] +- Add support for NXF_DEBUG to K8s task handler [ci fast] [828583dc] +- Add support for Mamba HTTP-based lock files [ci fast] [7fe88c84] +- Add container name validation [c3b6d9ab] +- Add Fusion for Google storage docs [34fcfe06] +- Improve K8s auth token discovery [ci fast] [44f8cc07] +- Bump nf-wave@0.7.2 [1c697ab5] +- Bump amazoncorretto:17.0.6 [a33a6f47] diff --git a/changelog/nextflow/v23.03.0-edge.mdx b/changelog/nextflow/v23.03.0-edge.mdx new file mode 100644 index 000000000..f66b40327 --- /dev/null +++ b/changelog/nextflow/v23.03.0-edge.mdx @@ -0,0 +1,40 @@ +--- +title: Nextflow v23.03.0-edge +date: 2023-03-19 +tags: [nextflow] +--- + +- Add Azure batch pool `virtualNetwork` option (#3723) [e3917b8e] +- Add `basePackages` option to Wave config [7e827810] +- Add error message for missing container image with Google Batch (#3747) [6419e68f] +- Add notifyFilePublish optional source argument (#3737) [a65a9ff7] +- Add retry strategy on Bash wrapper write logic [1e38274a] +- Add support for AWS S3 Glacier Retrieval Tier (#3680) [fab6bd5e] +- Add sync invocation on job completion (#3678) [e29c4e4b] +- Add `workflowId` to Wave request [025ff9d0] +- Add Clone result list objects before output binding [38762080] +- Add plugins option to kuberun command (#3766) [6515294f] +- Fix Google Batch logging exception [d7e38e9e] +- Fix Java Matcher serialization [6aecc4ed] +- Fix Logger failure type detection [f1b89c1f] +- Fix Orphaned processes when using Singularity [7236f830] +- Fix groupTuple with mismatching tuple cardinality [1d32e2c2] +- Fix special chars escaping in container env [b93634e9] +- Fix commit revision type for Azure DevOps repos (#3721) [fb71767e] +- Improve DAG API (#3703) [21afb358] +- Improve Wave docs [7299dac9] +- Improve `fair` directive docs (#3677) [7ca7520f] +- Improve transpose and groupTuple examples in the docs (#3685) [7870dfc8] +- Increase pwd obfuscation min length [ba23d036] +- Make GroupKey cloneable (#3738) [0760b0fd] +- Prepare Nextflow for the CWS Plugin (#3727) [fd8bf709] +- Remove DNAnexus page from docs (#3695) [fa58c18c] +- Remove outdated FAQ page from docs (#3683) [e59c7fbb] +- Remove unused classes [9fa8d75b] +- Update Azure VM sizes (#3751) [1d06e9a6] +- Enable Fusion on Google Batch tests [2f1b1094] +- Bump groovy 3.0.16 [d3ff5dcb] +- Bump nf-wave@0.8.0 [aa1b065d] +- Bump nf-google@1.7.1 [2aaaf2a7] +- Bump nf-azure@0.16.0 [f358b008] +- Bump nf-amazon@1.16.0 [2395187d] diff --git a/changelog/nextflow/v23.04.0.mdx b/changelog/nextflow/v23.04.0.mdx new file mode 100644 index 000000000..1e30c7d9d --- /dev/null +++ b/changelog/nextflow/v23.04.0.mdx @@ -0,0 +1,254 @@ +--- +title: Nextflow v23.04.0 +date: 2023-04-01 +tags: [nextflow] +--- + +- Add several names to the name generator feat:(#3790) [dfa2f6ca] +- Add support for Fusion to Azure Batch executor (#3209) [3d3cbfa2] +- Add support for testing custom plugin uri [227910ab] +- Add warnings for Azure named pools (#3819) [a2c71acf] +- Enable new pid namespace with Singularity & Apptainer [3601b014] +- Fix NoSuchMethodError String.stripIndent with Java 11 [308eafe6] +- Fix issue checking Google Batch script launcher type [39c3a517] +- Fix resolution of module resources [2c5a6878] +- Fix Relax caching across task retries [840e8432] +- Fix Java version for tests [7ce05c15] +- Remove extra context from workflow error message [38c8bd33] +- Revert "Enable Fusion on Google Batch tests" [2ba7ea54] +- Bump micromamba 1.4.1 [ec1439e6] +- Bump nf-amazon@1.16.1 [0f98b245] +- Bump nf-azure@1.0.0 [e1732be9] +- Bump nf-google@1.7.2 [99477f79] +- Bump nf-wave@0.8.1 [939195b5] +- Bump nf-tower@1.5.11 [b7b5d4c9] + +#### From previous edge releases + +23.03.0-edge - 19 Mar 2023 +- Add Azure batch pool virtualNetwork option (#3723) [e3917b8e] +- Add basePackages option to Wave config [7e827810] +- Add error message for missing container image with Google Batch (#3747) [6419e68f] +- Add notifyFilePublish optional source argument (#3737) [a65a9ff7] +- Add retry strategy on Bash wrapper write logic [1e38274a] +- Add support for AWS S3 Glacier Retrieval Tier (#3680) [fab6bd5e] +- Add sync invocation on job completion (#3678) [e29c4e4b] +- Add workflowId to Wave request [025ff9d0] +- Add Clone result list objects before output binding [38762080] +- Add plugins option to kuberun command (#3766) [6515294f] +- Fix Google Batch logging exception [d7e38e9e] +- Fix Java Matcher serialization [6aecc4ed] +- Fix Logger failure type detection [f1b89c1f] +- Fix Orphaned processes when using Singularity [7236f830] +- Fix groupTuple with mismatching tuple cardinality [1d32e2c2] +- Fix special chars escaping in container env [b93634e9] +- Fix commit revision type for Azure DevOps repos (#3721) [fb71767e] +- Improve DAG API (#3703) [21afb358] +- Improve Wave docs [7299dac9] +- Improve `fair` directive docs (#3677) [7ca7520f] +- Improve transpose and groupTuple examples in the docs (#3685) [7870dfc8] +- Increase pwd obfuscation min length [ba23d036] +- Make GroupKey cloneable (#3738) [0760b0fd] +- Prepare Nextflow for the CWS Plugin (#3727) [fd8bf709] +- Remove DNAnexus page from docs (#3695) [fa58c18c] +- Remove outdated FAQ page from docs (#3683) [e59c7fbb] +- Remove unused classes [9fa8d75b] +- Update Azure VM sizes (#3751) [1d06e9a6] +- Enable Fusion on Google Batch tests [2f1b1094] +- Bump groovy 3.0.16 [d3ff5dcb] +- Bump nf-wave@0.8.0 [aa1b065d] +- Bump nf-google@1.7.1 [2aaaf2a7] +- Bump nf-azure@0.16.0 [f358b008] +- Bump nf-amazon@1.16.0 [2395187d] + +23.02.1-edge - 26 Feb 2023 +- Add Fusion logs and tags config [09192078] +- Add support for NXF_DEBUG to K8s task handler [828583dc] +- Add support for Mamba HTTP based lock files [7fe88c84] +- Add container name validation [c3b6d9ab] +- Add Fusion for Google storage docs [34fcfe06] +- Improve K8s auth token discovery [44f8cc07] +- Bump nf-wave@0.7.2 [1c697ab5] +- Bump amazoncorretto:17.0.6 [a33a6f47] + +23.02.0-edge - 21 Feb 2023 +- Add Fusion support for Google Batch (#3577) [d5fbab4f] +- Add Header provider to Google Batch client [20979929] +- Add Wave integration tests [c5faf971] +- Add errorStrategy validation [954cd921] +- Add Java install recommendations to docs (#3617) [7e9bee1e] +- Add nextflow tags to AWS Batch job def [b465ac52] [BREAKING] +- Add readOnlyInputs option for CharliecloudBuilder (#3590) [8ae001fc] +- Add refresh token to Wave request [41510e87] +- Add requirements for container images to run with Nextflow (#3586) [7af1cb66] +- Add support for Fusion to Slurm and LSF executors (#3516) [fbc95e6b] +- Add support for Fusion tags (#3609) [8385ec22] [BREAKING] +- Add support for the Spack package manager (#3580) [a5df62f6] +- Add the fcp tool option to file copy strategy (#3556) [2a224258] +- Add Fusion integration test +- Add Wave + Fusion test with Google Batch [b541c061] +- Add support for entryless Fusion configuration and Singularity support (#3584) [34a27733] +- Improve Fusion config [a1d08463] +- Ignore resource directives if -l option is specified in PBS executor (#3015) [28a67969] +- Improve K8s securityContext support [3f76240b] +- Improve AWS Batch error logging [8f4884c1] +- Improve secrets docs [9a3b4214] +- Improve Wave debug-task plugin command [cf3fd747] +- Improve Wave logging [fced3761] +- Increase Wave token duration to 30 mins [e1a712c2] +- Fix -with-apptainer cli option (#3621) [8c9588fe] +- Fix GH action tests step [bb890d9a] +- Fix Spack failing test [868374d3] +- Fix Tower doc links, fix typos (#3647) [1278e1a5] +- Fix Wave cli messages [10cf414b] +- Fix collectFile cache over remote storage [762ba19c] +- Fix output env var tokenize [40d56735] +- Fix plugin install version [59e9a91b] +- Fix race condition on Wave requests [f57fae2c] +- Fix serialization of S3 paths with spaces (#3565) [ce487624] +- Fix string literal method names with parens (#3604) [8278078a] +- Fix submit command in error message for grid executors that pipe wrapper script (#3548) [40ebd308] +- Fix typos in the documentation [skip ci] (#3640) [eccc1130] +- Fix unique fingerprint for Wave bundle resources [b59fa728] +- Log exception when an unexpected occurs (#3603) [9aeca99f] +- Minor change on container resolution [23d47ded] +- Refactor httpfs configuration [445218a8] +- Remove deprecated buckets field [0a355ac3] +- Remove leading/trailing special chars from tag [7d3cc707] +- Remove unused `-with-k8s` CLI option (#3624) [85b6e7d3] +- Update config.rst (#3655) [1555e188] +- Update Fusion docs [12782eeb] +- Bump Fusion 2.1 [f48ef5b3] +- Bump Groovy 3.0.15 [7a3ebc7d] +- Bump Micromamba 1.3.1 [aa2bf37e] +- Bump Spock 2.3 [9f0dac31] +- Bump nf-wave@0.7.1 [b797fac2] +- Bump nf-tower@1.5.10 [dd2f69dd] +- Bump nf-google@1.7.0 [8cb9fa35] +- Bump nf-amazon@1.15.0 [7ccca430] + +23.01.0-edge - 14 Jan 2023 +- Add support for rclone as stageOutMode option [fde2ac27] +- Add queueGlobalStatus config setting [f3339541] +- Add support for bearer token to GithubRepositoryProvider [c4d39384] [a2d2cbf60] +- Add -with-fusion cli option [d22337cd] +- Add support for Fusion container custom options [56e29d35] +- Add `schedulingPriority` option to AWS Batch (use with `shareIdentifier`) (#3505) [06960bb2] +- Fix support for AWS ACL for Batch #2671 [a9644919] +- Fix Java options.release in Gradle build [b362d6f6] +- Fix nf-httpfs module name in build file [568e47f6] +- Fix GitHub creds in CI build [4c4d3f81] +- Fix FilePorter concurrency issue (#3511) [11ccfa26] +- Fix watchPath hang shutdown execution [bac0cedf] +- Fix "no such file" error message to "no such file or directory" (#3547) [c292d84e] +- Improve local exec workdir validation [4a3a2720] +- Improve container native executor configuration [03126371] +- Improve AWS batch exit code reporting [d1bb2fe2] +- Improve channel factories error message [0215b9fc] +- Improve Google Batch executor [c0a25fc2] +- Improve Fusion config [902e5b34] [52f4c5d5] +- Improve redirection on Wave client [124cfb3e] +- Remove unnecessary Fusion env var [dfa47556] +- Remove deprecated method 'just' [d17b3c46] +- Remove deprecated methods [75e65035] +- Remove DSL1 deprecated code [5d290a47] +- Cleanup build from tmp manifests [326b3839] +- Minor compilation improvements [4188a6ac] +- Migrate all tests to DSL2 [14257d49] +- Bump 23.01.0-edge version [9ec31444] +- Bump groovy 3.0.14 [7c204236] [6f3ed6e8] +- Bump Grengine 3.0 [c0b1a7a6] +- Bump nf-wave@0.7.0 [45d274e3] +- Bump nf-tower@1.5.9 [db0ebe72] +- Bump nf-google@1.6.0 [a663fe16] +- Bump nf-console@1.0.5 [45fd53ad] +- Bump nf-codecommit@0.1.3 [cf39ef8f] +- Bump nf-azure@0.15.1 [7a6a78aa] +- Bump nf-amazon@1.14.0 [41fdcc72] + +22.12.0-edge - 13 Dec 2022 +- Add `fair` process directive [60d34cfd] +- Add support for singularity registry setting [37c1aeb9] +- Add AWS profile config setting [66f4669f] +- Add support for AWS profile when resolving region [d8947707] +- Add support for Sarus container engine (#3470) [54673f18] +- Add support for Fusion ARM64 client [d073c538] +- Add allowedLocations option to google batch (#3453) [c619eb81] +- Add support for AWS config profile in NF config [37112672] +- Add warning on Google Logs failure [bdbcdde9] +- Add possible values of `status` in `trace.txt` to the documentation (#3451) [2425fcfb] +- Add support for AWS Glacier restore [b6110766] +- Add support for S3 storageClass to publishDir [066f9203] +- Add MathHelper utility class [7eecb266] +- Fix Wave layer invalid checksum due to not closed stream [e188bbf9] +- Fix Fusion test [2245a1c7] +- Fix Run fails when home is a symlink [9ff820f4] +- Fix math overflow when copying large AWS S3 files [f32ea0ba] +- Fix Quote the logName in the Cloud Logging filter (#3464) [b3975063] +- Fix Google Batch cloud logging (#3443) [e2bbcf15] +- Fix Tower plugin min nextflow requirement [1713a1cd] +- Fix TowerArchiver resolve envar paths relative to baseDir (#3438) [46af18e5] +- Error & info messages, code comments language fixes (#3475) [29ae36ca] +- Replace `egrep` with `grep -E` (#3485) [ac0c3035] +- Gradle build optimizations (#3483) [19182a57] +- Refactor virtual FS schemes to XPath class [fd59b943] +- Update concat operator description (#3426) [e8d8c3b5] +- Clarify usage of additional options for path qualifier (#3405) [0b70acb1] +- Clarify limitation of `-with-docker` in the docs (#3408) [79afc85d] +- Expose process queue as K8s pod label [4df8c8d2] +- Prefix nextflow K8s labels with `nextflow.io` prefix [9951fcd9] +- Remove deprecated code [c0b164f2] +- Rewrite fetchIamRole and fetchRegion to use AWS SDK (#3425) [e350f319] +- Improve Wave config error reporting [ae502668] +- Improve K8s retry on transient failures [d86ddc36] +- Remove DSL1 output mode [fa400d5f] +- Remove support for DSL1 multi into [f664af45] +- Bump nf-amazon@1.13.0 [ccaab713] +- Bump nf-google@1.5.0 [c07dcec2] +- Bump nf-wave@0.6.3 +- Bump nf-tower@1.5.8 [652d0880] +- Bump fusion version URLs 0.6 [a160a8b1] +- Bump AWS sdk version 1.12.351 [4dd82b66] + +22.11.1-edge - 29 Nov 2022 +- Fix TowerArchiver resolve envar paths relative to baseDir (#3438) [53e6348c] +- Fix tower plugin min nextflow requirement [103dbf74] +- Fix typos in the documentation (#3441) [ae95d90d] +- Add support for Java 19 [811e7ca8] +- Add support for custom conda channels (#3435) [0884e80e] +- Add time directive to AWS Batch, clean language (#3436) [1ed2640a] +- Update err message [ab5bd81b] +- Fix Flux executor config (#3432) [68b45c92] +- Bump nf-wave@0.6.1 [fe669152] +- Bump nf-tower@1.5.7 [2dbf9906] + +22.11.0-edge - 23 Nov 2022 +- Add support for Apptainer container engine (#3345) [29f98975] +- Add Flux executor to nextflow (#3412) [cc9fc3f0] [3711cef0] +- Add support for Wave containerPlatform [10d56ca1] +- Add CSI ephemeral volume for K8s (#2988) [f18f6e81] +- Add support for disk directive and emptyDir to K8s (#2998) [b548e1c7] +- Add Fusion support for custom S3 endpoints [fba9b649] +- Add support for Tower refresh token for dataset (#3366) [a19e055a] +- Prevent infinite loop while fetching git tags and branches [aa974d44] +- Improve file porter logging [626420b6] +- Improve script err logging [2714770e] +- Extend onFilePublish notification adding source path (#3284) [81acc3ef] +- Remove cpu limits from K8s pod spec builder (#3338) [dc7f78bf] +- Improve task name logging [5ddb7e3f] +- Add tower endpoint to wave [b725ddc4] +- Add Azure SAS token validation [e2244b48] +- Use cpus-shares for container resources (#3383) [b38c3880] +- Report full path scheme on error [4089ba65] +- Allow identity based authentication on Azure Batch (#3132) [a08611be] +- Fix support for remote file mail attachment (#3384) [6b496bb9] +- Fix task cache logging [ed37c4fd] +- Fix unexpected error on task resume [1c3f4685] +- Fix stripIndent failure with java 17 (#3377) [2b115c50] +- Fix -dockerized execution #3137 (#3148) [64a81a58] +- Improve default value in cli help of `nextflow log -s` (#3371) [2141f96e] +- upgrade jsoup and snakeyaml version (#3374) [6e2ca454] +- Bump Java 17 lang version + Java 11 as target [34f133e2] +- Bump nf-amazon@1.12.0 [e307912e] +- Bump nf-azure@0.15.0 [07391d96] +- Bump nf-wave@0.6.0 [4d787561] diff --git a/changelog/nextflow/v23.04.1.mdx b/changelog/nextflow/v23.04.1.mdx new file mode 100644 index 000000000..9e1cd9172 --- /dev/null +++ b/changelog/nextflow/v23.04.1.mdx @@ -0,0 +1,23 @@ +--- +title: Nextflow v23.04.1 +date: 2023-04-15 +tags: [nextflow] +--- + +- Add support for Java 20 [f6933db7] +- Fix use of remote dir with local exec statement [6ea1f68c] +- Fix Azure pool creation when using scaling formula (#3868) [84a808a5] +- Fix interval channel factory (#3848) [82ccf6ad] +- Fix invalid warning on func import (#3807) [4678ffe3] +- Improve plugin test detection [57cfb0d9] +- Improve plugin updater err handling [5627c69a] +- Security fixes [83e8fd6a] +- Bump nf-wave@0.8.2 [d8cb763c] +- Bump nf-tower@1.5.12 [b2354380] +- Bump nf-google@1.7.3 [22a68cfe] +- Bump gson:2.10.1 [83ca1e32] +- Bump nf-ga4gh@1.0.5 [b40b5165] +- Bump nf-codecommit@0.1.4 [98a89154] +- Bump aws-java-sdk-s3:1.12.429 [b71ee0a3] +- Bump nf-azure@1.0.1 [a5da54d3] +- Bump nf-amazon@1.16.2 [c90553c9] diff --git a/changelog/nextflow/v23.04.2.mdx b/changelog/nextflow/v23.04.2.mdx new file mode 100644 index 000000000..120b6d29d --- /dev/null +++ b/changelog/nextflow/v23.04.2.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v23.04.2 +date: 2023-06-08 +tags: [nextflow] +--- + +- Fix non-deterministic `null` container engine error [f93221ab] +- Add retry policy to Wave client [2f1532f6] +- Fix wave build docs [34a73022] +- Bump nf-wave@0.8.3 [350201b5] diff --git a/changelog/nextflow/v23.04.3.mdx b/changelog/nextflow/v23.04.3.mdx new file mode 100644 index 000000000..6d8d03b90 --- /dev/null +++ b/changelog/nextflow/v23.04.3.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v23.04.3 +date: 2023-08-11 +tags: [nextflow] +--- + +- Add 429 http status code to Wave retriable errors [a8b8c6c5] +- Increase Wave client max attempts [8c67610a] +- Improve handling Wave server errors [621c9665] +- Fix log typo [03e19ea2] +- Bump nf-wave@0.8.4 [d7fa3f26] +- Bump corretto 17.0.8 [7a73a78f] diff --git a/changelog/nextflow/v23.04.4.mdx b/changelog/nextflow/v23.04.4.mdx new file mode 100644 index 000000000..efbe4ae0c --- /dev/null +++ b/changelog/nextflow/v23.04.4.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v23.04.4 +date: 2023-09-25 +tags: [nextflow] +--- + +- Fix use of GITHUB_TOKEN variable to access GitHub repo [108c6b55] +- Fix allow_other vulnerability preventing google-batch submissions (#4332) [4895d547] +- Fix Prevent false positive resumable task [aae87715] +- Fix Always emit publish event for cached task outputs (#4227) [c4cd53c2] +- Fix Too long Http connection pool timeout [ce5e9930] +- Bump nf-google@1.7.3-patch1 [d881728c] diff --git a/changelog/nextflow/v23.04.5.mdx b/changelog/nextflow/v23.04.5.mdx new file mode 100644 index 000000000..3fcbac249 --- /dev/null +++ b/changelog/nextflow/v23.04.5.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v23.04.5 +date: 2024-01-12 +tags: [nextflow] +--- + +- Fix container environment with special chars (#4594) [663b2936] diff --git a/changelog/nextflow/v23.05.0-edge.mdx b/changelog/nextflow/v23.05.0-edge.mdx new file mode 100644 index 000000000..08ad3d5d2 --- /dev/null +++ b/changelog/nextflow/v23.05.0-edge.mdx @@ -0,0 +1,68 @@ +--- +title: Nextflow v23.05.0-edge +date: 2023-05-15 +tags: [nextflow] +--- + +23.05.0-edge - 15 May 2023 +- Add support for custom custom root directory to resolve relative paths (#3942) [f06bb1f7] +- Add `arch` directive support for Spack (#3786) [62dfc482] +- Add clone deep option to run and pull commands [b44b6453] +- Add fusion.exportStorageCredentials option [acb6aedf] +- Add groovy-yaml to core runtime [003e1f70] +- Add missing test env variables to CI build [a0e501bf] +- Add splitJson Operator (#3830) [4f58f695] +- Add support for Java 20 [3788a689] +- Add support for `time` directive in Azure Batch (#3869) [5c11a0d4] +- Add support for the Spack recipes to Wave build (#3636) [b03cbe70] +- Add Preview support for virtual threads (#3871) [5c429046] +- Convert docs to Markdown (#3196) [3cad402f] +- Deprecate DSL1 syntax for tap operator (#3004) [2be0edfe] +- Enable static compilation to missing classes (#3906) [c3c4b2f0] +- Fix -with-conda option in the docs (#3867) [9b350ba8] +- Fix AWS SSE env propagation to Fusion [e24608c3] +- Fix Apptainer rendering by removing superflous space [36607ed1] +- Fix Azure jobs correctly deleted after completion (#3927) [b173a983] +- Fix Azure pool creation when using scaling formula (#3868) [79984a87] +- Fix DSL2 support in nextflow console (#3864) [0253f8d7] +- Fix K8s handling PodUnschedulableException (#3938) [5b756c63] +- Fix `interval` channel factory (#3848) [d001e4c7] +- Fix invalid warning on func import (#3807) [bb836960] +- Fix minor typo in nextflow subcommand (#3853) [dd3be3d1] +- Fix misleading error message on NoSuchFileException [f3dceba6] +- Fix missing SAS token fusion env for Azure [43015029] +- Fix problem args were not correctly represented in debug yaml (#3904) [eeb4b5c8] +- Fix string comparison in S3 client (#3875) [9344d294] +- Fix use of remote dir with local exec statement [850bc3d9] +- Fix Quote Singularity/Apptainer env values [586417ac] +- Improve handling default out param [91471970] +- Improve plugin test detection [29794bf4] +- Improve plugin updater err handling [f3d72f22] +- Improve task out redirect remove the use of mkfifo (#3863) [efedec74] +- Improve Use Docker stop instead of docker kill [32e6fd85] +- Improve Use separate script for long stage/unstage commands (#3851) [4343e333] +- Increase Azure default maxRetries to 10 [a017139f] +- Keep plugins-info content sorted [d5552ee6] +- Minor change on Docker-spack templates [e0e24bda] +- Refactor the AWS configuration (#3498) [a74e42d9] +- Remove `Channel.from` in favor of `Channel.of` from tests and docs (#3670) [aa8b72fa] +- Rename AmazonS3Client to S3Client [cc59596a] +- Rename com.upplication.s3fs package to nextflow.cloud.aws.nio [a2f3bb24] +- Run build CI tests on push to branches starting with `test*` or `dev*` (#3852) [7032e17c] +- Security fixes [973b7bea] +- Support enums in cache helper (#3901) [e4b977a4] +- Bump slf4j 2.0.7 and logback 1.4.6 [d7eae86e] +- Bump JGit 6.5 and use depth 1 when cloning repos [eda0845c] +- Bump aws-java-sdk-s3:1.12.429 [465171f5] +- Bump fusion 2.2 [f1ebe29a] +- Bump groovy 3.0.17 [cfe4ba56] +- Bump gson:2.10.1 [be555683] +- Bump micromamba:1.4.2 [334df1e0] +- Bump nf-wave@0.9.0 [7d6d0108] +- Bump nf-tower@1.5.13 [b06ffd0c] +- Bump nf-google@1.7.4 [2e0a15cd] +- Bump nf-ga4gh@1.0.6 [0c8fd7df] +- Bump nf-console@1.0.6 [a733b818] +- Bump nf-codecommit@0.1.5 [12edf0e6] +- Bump nf-amazon@2.0.0 [69b6edde] +- Bump nf-azure@1.1.0 [d05d51b4] diff --git a/changelog/nextflow/v23.06.0-edge.mdx b/changelog/nextflow/v23.06.0-edge.mdx new file mode 100644 index 000000000..7b8d05296 --- /dev/null +++ b/changelog/nextflow/v23.06.0-edge.mdx @@ -0,0 +1,42 @@ +--- +title: Nextflow v23.06.0-edge +date: 2023-06-14 +tags: [nextflow] +--- + +- Add Wave containers reports (preview) [9d9e2758] +- Add disk resource with type option for Google batch (#3861) [166b3638] +- Add httpConnectTimeout and httpReadTimeout to Google options (#3974) [49fa15f7] +- Add plugin cmd help description [d3788f9f] +- Add retry policy on Az blob operations [295bc1ff] +- Add retry policy to Wave HTTP client [1daebeef] +- Add support for AWS SES as mail sending provider [df85d443] +- Add support for arch auto-detection to Wave [7b5fdaf0] +- Add `wave.httpClient.connectTimeout` config option [dd999a3c] +- Clarify tip about groupTuple size and groupKey (#3949) [e60d327f] +- Consolidate Wave `retryPolicy` options [7d7464fe] +- Enhanced support for Spack + Wave (#3998) [63ac03b3] +- Fix Google Batch default instance family types (#3960) [b5257cd7] +- Fix S3 path normalization [b75ec444] +- Fix access to public S3 bucket when no creds are provided (#3992) [cf8ba466] [680f0a90] +- Fix `containerOptions` when using Fusion [dcde7b7f] +- Fix dump pretty print not to modify input (#3955) [46c17ee3] +- Fix invalid machine type setting when no valid machine type is found (#3961) [5eb93971] +- Fix matching symlink files [d63af784] +- Fix missing options for JsonSplitter creation (#3958) [f991fe9e] +- Fix non-deterministic null container engine error [f227f2e5] +- Fix packing all, including Wave [735b8d9c] +- Fix static compiler errors [f48a473c] +- Improve documentation on Nextflow scripts (#3953) [80050c03] +- Minor change in Wave config [4da0442a] +- Prevent null exit code when Google batch is unable to access exit status [f68a39ec] +- Refactor Conda and Spack support for Wave to Java [36b9e226] +- Remove `--no-home` default option from charliecloud builder (#3956) [915074a4] +- Update `workflow.revision` max length to match the one in Tower (#4010) [1433a903] +- Bump amazocorretto:17.0.7 [c8aa1214] +- Bump azure-storage-blob:12.22.1 [2a36fa77] +- Bump nf-wave@0.10.0 [0872fba5] +- Bump nf-tower@1.5.14 [64bf3115] +- Bump nf-google@1.8.0 [7ca7d808] +- Bump nf-azure@1.1.1 [afd368c4] +- Bump nf-amazon@2.0.1 [58c332a1] diff --git a/changelog/nextflow/v23.07.0-edge.mdx b/changelog/nextflow/v23.07.0-edge.mdx new file mode 100644 index 000000000..12c806df0 --- /dev/null +++ b/changelog/nextflow/v23.07.0-edge.mdx @@ -0,0 +1,47 @@ +--- +title: Nextflow v23.07.0-edge +date: 2023-07-22 +tags: [nextflow] +--- + +23.07.0-edge - 23 Jul 2023 +- Add CPU model name to trace files and traceRecord (#3946) [e0d91bf7] +- Add ability to disable CLI params type detection [9a1c584d] +- Add cloudcache plugin (#4097) [ac90cc26] +- Add missing header to Wave container await [d39866e6] +- Add remote bin support for TES in a workdir (#3990) [8a22168a] +- Add retry logic to wave image await [9fc1d3bd] +- Add rule to build Nextflow docker image for ARM (#4020) [705d55f5] +- Add support for AWS SSO credentials provider (#4045) [53e33cde] +- Add support for Wave container freeze [9a5903e6] +- Add support legacy Wave retry [73a1e7d4] +- Allow SLURM executor option `--mem-per-cpu` (#4023) [96c04e3b] +- Allow disabling the Wave requirement when Fusion is enabled [9180d633] +- Disable Singularity and Apptainer home mount by default (#4056) [a0ee4657] +- Document `NXF_WRAPPER_STAGE_FILE_THRESHOLD` environment variable (#4113) [ci skip] [bda47567] +- Fix AzFileSystem retry policy [ba9b6d18] [c2f3cc96] +- Fix Improve error message for invalid Azure URI [0f4d8867] +- Fix Treat HTTP headers as case insensitive (#4116) [97fd3358] +- Fix invalid detection of hierarchical namespace stub blobs as files (#4046) [ce06c877] +- Fix stage script in Fusion script launcher (#4109) [0933f47e] +- Ignore accelerator type for AWS Batch (#4043) [263ecca8] +- Implement Weblog feature as an external plugin [f9f2c338] +- Improve "Unexpected input: '{'" error message (#4122) [ef9d3cf0] +- Improve Azure retry logging [de58697a] +- Improve description of channels and channel types (#4120) [8975734d] +- Improve handling Wave server errors [84f7a61a] +- Increase Azure min retry delay to 250ms [2e77e5e4] +- Remove default arch from wave request [f0e5c0c1] +- Remove logging of report JSON data (#4098) [099e5039] +- Wait for all child processes in nxf_parallel (#4050) [60a5f1a7] +- Bump Groovy 3.0.18 [207eb535] +- Bump micromamba 1.4.9 [6307f9b5] +- Bump nf-amazon@2.1.0 [57464746] +- Bump nf-azure@1.1.2 [e1512f6a] +- Bump nf-azure@1.1.3 [27e7f663] +- Bump nf-azure@1.1.4 [1895efc4] +- Bump nf-cloudcache@0.1.0 [cb6242c4] +- Bump nf-ga4gh@1.1.0 [f98feb77] +- Bump nf-google@1.8.1 [6aede7c0] +- Bump nf-tower@1.5.15 [3278d798] +- Bump nf-wave@0.11.0 [2998db5d] diff --git a/changelog/nextflow/v23.08.0-edge.mdx b/changelog/nextflow/v23.08.0-edge.mdx new file mode 100644 index 000000000..f9017d321 --- /dev/null +++ b/changelog/nextflow/v23.08.0-edge.mdx @@ -0,0 +1,33 @@ +--- +title: Nextflow v23.08.0-edge +date: 2023-08-05 +tags: [nextflow] +--- + +- Add `-value` option to `config` command (#4142) [57e3100b] +- Add `deleteTasksOnCompletion` to Azure Batch configuration (#4114) [b14674dc] +- Add Tower logs checkpoint (#4132) [71dfecc2] +- Allow use virtual threads in Wave client [dd32f80a] +- Allow workflow entry from module import (#4128) [51f5c842] +- Disable cache backup/restore if cloudcache is used (#4125) [46e828e1] +- Document behavior of withName selector with included aliases (#4129) [8b7e3d48] +- Fix Option fixOwnership traverse parent directories [f2a2ea35] +- Fix Redirection http redirection across different hosts [fcdeec02] +- Fix Wave disable flag [8579e7a4] +- Fix bug with K8s resource labels (#4147) eu-west-1[3f4b8557] +- Fix glob resolution for remove files [19a72c40] +- Fix incorrect error message on missing comma (#4085) eu-west-1[a59af39f] +- Fix missing changelog for version 23.07.0-edge eu-west-1[9a33e936] +- Fix strict mode docs (#4150) [6b46b507] +- Improve plugin docs (#3957) [22638d46] +- Improve Wave config logging [547fad62] +- Improve TaskPollingMonitor logging [077ed5dd] +- Improve Wave and Fusion docs (#4149) [d2229bde] +- Increase Wave client max attempts [fe5dd497] +- Remove module all components import [a6d08c04] +- Restore Tower CacheManager for backward compatibility [6d269070] +- Bump amazoncorretto:17.0.8 [00eb145c] +- Bump nf-wave@0.11.1 [78e4b278] +- Bump nf-tower@1.6.0 [41c8c164] +- Bump nf-azure@1.2.0 [5f33ac17] +- Bump nf-amazon@2.1.1 [981315ad diff --git a/changelog/nextflow/v23.08.1-edge.mdx b/changelog/nextflow/v23.08.1-edge.mdx new file mode 100644 index 000000000..bae5a0c68 --- /dev/null +++ b/changelog/nextflow/v23.08.1-edge.mdx @@ -0,0 +1,33 @@ +--- +title: Nextflow v23.08.1-edge +date: 2023-08-17 +tags: [nextflow] +--- + +- Add 429 http status code to Wave retriable errors [8eb5f305] +- Add resource labels support for Azure Batch (#4178) [7b5e50a1] +- Apply K8s Pod metadata to Job (#4057) [4d918627] +- Document error about trailing backslash with space (#4180) [245afa5d] +- Enable cloud cache based on environment variable (#4160) [a66b0e63] +- Escape semicolons in paths (#4193) [552501ce] +- FIx nested InvocationTargetException (#4192) [67980f19] +- Fix Execution should fail if report or timeline file already exists [b238d7e2] +- Fix Process hangs when using flatten and finish errorStrategy [d99b3432] +- Fix `workflow.container` map resolution (#4190) [96ab8a69] +- Fix checkpoint thread termination (#4166) [2b449daa] +- Fix env output when changing task workdir [8e4d7fed] +- Fix if-guard on log.trace in trask processor inner class [50f6f6d5] +- Fix typos in source code comments (#4173) [e78bc37e] +- Improve Conda build error report [7b19fb03] +- Improve handling of name-only container env variables [3051cd13] +- Minor changes [7e58c945] +- Remove dockerize launcher classpath file (#4191) [2bae5198] +- Remove lock file from cloudcache (#4167) [6e6ea579] +- Update AWS instructions for creating a custom AMI (#4174) [563bff13] +- Update changelog [98f88a50] +- Update tip about modifying maps (#4153) [30036dbf] +- Use root user in Wave container based on micromamba (#4038) [a3a75ea2] +- Bump nf-azure@1.3.0 [6670bb06] +- Bump nf-cloudcache@0.2.0 [fb8f6681] +- Bump nf-tower@1.6.1 [d06b8365] +- Bump nf-wave@0.11.2 [7555b17d] diff --git a/changelog/nextflow/v23.09.0-edge.mdx b/changelog/nextflow/v23.09.0-edge.mdx new file mode 100644 index 000000000..c4ea00311 --- /dev/null +++ b/changelog/nextflow/v23.09.0-edge.mdx @@ -0,0 +1,52 @@ +--- +title: Nextflow v23.09.0-edge +date: 2023-09-10 +tags: [nextflow] +--- + +- Add check for latest version (#4194) [3e8cd488] +- Add inspect command (#4069) [090c31ce] +- Add maxSubmitAwait (#3736) [5686bf1d] +- Add scripts logging for troubleshooting [c056a74e] +- Add support for Spack to Singularity builds [23c4ec1d] +- Add support for Wave native build for Singularity [8a434893] +- Add support for inputs and outputs arity [42504d3c] +- Add support for remote debug (#4266) [87e0648a] +- Add warning about using clusterOptions with process directives (#4248) [a68c1a3e] +- Add which to dockerfile build [817aa05b] +- Align Singularity experience with Docker (#4230) [a1e1d3ca] [c1cc60dd] +- Allow setting shell directive when using the trace file (#4210) [7d6ad624] +- Always emit publish event for cached task outputs (#4227) [62686ce8] +- Deprecated Wave report feature [80c5cb27] +- Disable staging script for remote work dir (#4282) [80f7cd46] +- Disable version check on CI tests [db79e13f] +- Docs improvement to clarify the usage of the bin dir (#4121) [2daa4172] +- Document API differences of process path inputs (#4189) [c37e00bc] +- Document use of local variables in closures (#4251) [05ff784a] +- Fix IOException should be thrown when failing to creare Azure directory [b0bdfd79] +- Fix Parallel execution of Conda corrupts data and packages (#4253) [976c282c] +- Fix Parse negative CLI params as numbers (#4238) [1ae70d5d] +- Fix Too long Http connection pool timeout [fa961e7f] +- Fix Wave build for Singularity files [a60ef72b] +- Fix Wave build when Conda package name is quoted [d19cb0b7] +- Fix failing test [2785ffe9] +- Fix fs cp command with remote file [366eedec] +- Fix printf command with negative exit code (#4213) [465468b0] +- Fix security deps in nf-azure plugin [c30d5211] +- Fix setting `executor.queueSize = 0` is ignored (#4228) [6664b578] +- Improve Wave handing of Conda envs [736ab9bb] +- Improve pod options documentation (#4274) [c3aa26e1] +- Make TraceRecord@store field public accessible [07582f0b] +- Remove -dsl1 and -dsl1 rub cli options [b6721b71] +- Remove experimental -dockerize option /2 [7def5542] +- Remove experimental -dockerize option [937c8fb7] +- Report an error on duplicate workflow name definitions (#4088) [fce9702e] +- Undocument internal NXF_DEBUG variable [7955db8d] +- Update AZ File share doc (#4235) [69d317b6] +- Update docs about splitCsv() operator (#4163) [1dfb621c] +- Update documentation of NXF_DEBUG (#4187) [a88a4245] +- Use sipHash24 in place of deprecated murmur32 for script aliasing [bb96763f] +- Bump groovy 3.0.19 [cb411208] +- Bump nf-amazon@2.1.2 [7e5d414e] +- Bump nf-azure@1.3.1 [83410f39] +- Bump nf-wave@0.12.0 [a9f6dd65] diff --git a/changelog/nextflow/v23.09.1-edge.mdx b/changelog/nextflow/v23.09.1-edge.mdx new file mode 100644 index 000000000..c1b4909c6 --- /dev/null +++ b/changelog/nextflow/v23.09.1-edge.mdx @@ -0,0 +1,7 @@ +--- +title: Nextflow v23.09.1-edge +date: 2023-09-11 +tags: [nextflow] +--- + +- Revert "Allow setting shell directive when using the trace file (#4210)" [9f9edcdc] diff --git a/changelog/nextflow/v23.09.2-edge.mdx b/changelog/nextflow/v23.09.2-edge.mdx new file mode 100644 index 000000000..fa36655be --- /dev/null +++ b/changelog/nextflow/v23.09.2-edge.mdx @@ -0,0 +1,43 @@ +--- +title: Nextflow v23.09.2-edge +date: 2023-09-27 +tags: [nextflow] +--- + +- Add `conda.enabled` to conda config scope docs (#4320) [0b74c4e2] +- Add developer docs (#4065) [06843d87] +- Add `fs stat` command [a79056b7] +- Add more tests to container name [da7a1942] +- Add `procps` by default to Conda-based Wave builds [66b2d2d2] +- Add support for Java 21 (#4338) [ac1fc9ee] +- Add Mermaid diagram in HTML DAG (#4337) [0f3e263f] +- Default Conda `basePackages` to `conda-forge::procps-ng` [367af52f] +- Disable Tower container field for multiple images [b53936b0] +- Document `NXF_DISABLE_CHECK_LATEST` environment var (#4327) [4e3e9aca] +- Document `fs` CLI command (#4328) [1a680495] +- Document source of `vol_ctxt` and `inv_ctxt` trace metrics (#4333) [6525b0a1] +- Document when process directives are evaluated (#4217) [731a29a2] +- Fix List of S3 bucket for custom endpoint [4327fa58] +- Fix Prevent false positive resumable task [144e0a8a] +- Fix Prevent multi attempts to retrieve AWS creds [b30efe36] +- Fix `allow_other` vulnerability preventing google-batch submissions (#4332) [9b3741e3] +- Fix `fs list` command [29ab2f24] +- Fix minor typos in changelogs/source code (#4319) [4ce9f1df] +- Fix support for S3 custom endpoint with anonymous access [03752815] +- Fix use of `GITHUB_TOKEN` variable to access GitHub repo [afe3dc4f] +- Fix Wave does not support 'null' container engine [f3eba3d7] +- Fix Retry TimeoutException in Azure file system (#4295) [79248355] +- Improve K8s unit tests (#4196) [5a43a32b] +- Improve Mermaid DAG rendering (#4070) [19587f40] +- Improve error report when exception is thrown in operator ctx [16f54a9c] +- Improve wave container name validation [73eb5a02] +- Minor improvements [fff3d7bd] +- Prevent cache invalidation for task directives (#4339) [aabb6c19] +- Remove line endings from container box id (#4334) [df41e54a] +- Bump Apache 2.0 license to tower client [e4a878b6] +- Bump nf-amazon@2.1.3 [3311172f] +- Bump nf-azure@1.3.2 [a9b735ce] +- Bump nf-google@1.8.2 [7219d7f2] +- Bump nf-tower@1.6.2 [91a935f9] +- Bump nf-wave@0.13.0 [0cf2476c] +- Bump wave-utils@0.7.8 [d0c47d49] diff --git a/changelog/nextflow/v23.09.3-edge.mdx b/changelog/nextflow/v23.09.3-edge.mdx new file mode 100644 index 000000000..36fde1283 --- /dev/null +++ b/changelog/nextflow/v23.09.3-edge.mdx @@ -0,0 +1,24 @@ +--- +title: Nextflow v23.09.3-edge +date: 2023-10-10 +tags: [nextflow] +--- + +- Add `-cloudcache` CLI option (#4385) [73fda582] +- Add `bioconda` and `seqera` Conda default channels (#4359) [ff012dcd] +- Add codespell: config, workflow and have typos fixed (#4324) [e044b7a5] +- Add docs page on caching and resuming (#4371) [21190a3c] +- Add example of using the transpose operator with multiple items in element (#4364) [0bce2be0] +- Add setting to enable the use of sync command [f0d5cc5c] +- Improve S3 endpoint validation [2b9ae6aa] +- Improve Wave config validation [7d5a21b0] +- Improve Wave error handling [d47e8b07] +- Fix Google Batch not stopping running jobs (#4381) [3d6b7358] +- Incorporate README content into Nextflow docs (#4263) [74a0f998] +- Never say (nearly) Oops again (#4356) [4a39542b] +- Remove unsupported K8s device capability [be0cf0c2] +- Remove unused -dsl2 option [3cb91a15] +- Rename Microsoft AAD to Microsoft Entra (#4362) [5e3f2c0a] +- Return -1 when exitcode file is empty (#4354) [d26c42be] +- Support for Fusion unprivileged execution (#4387) [035e6e7b] +- Use HistoryFile.Record instead of Record type conflict [11c3aac5] diff --git a/changelog/nextflow/v23.10.0.mdx b/changelog/nextflow/v23.10.0.mdx new file mode 100644 index 000000000..5f178d13f --- /dev/null +++ b/changelog/nextflow/v23.10.0.mdx @@ -0,0 +1,342 @@ +--- +title: Nextflow v23.10.0 +date: 2023-10-16 +tags: [nextflow] +--- + +- Add support for K8s hostPath [10c32325] +- Add AWS SES docs [b83e7148] +- Add -with-cloudcache instead of -cloudcache [ef530263] +- Add inspect command validation tests [882f369e] +- Improve warning complaining about tuple but mentioning set (#4400) [0ef48735] +- Improve `-dump-hashes` output adding json format (#4369) [5bdaac94] +- Improve error message on invalid file url prefix [82a3f405] +- Fix conda channels order [6672c6d7] +- Docs: Incorporate DSL2 features (#3793) [efd041cb] +- Docs: aws.batch.retrymode = 'built-in' (#4229) [d5a8098f] +- Docs: Update logos, fonts, and colors (#4407) [7814822c] +- Changelog minor changes [dfb5bf09] +- Bump nf-wave@1.0.0 [795849d7] + +**From previous egde releases** + +23.09.3-edge - 10 Oct 2023 +- Add -cloudcache CLI option (#4385) [73fda582] +- Add bioconda and seqera Conda default channels (#4359) [ff012dcd] +- Add codespell: config, workflow and have typos fixed (#4324) [e044b7a5] +- Add docs page on caching and resuming (#4371) [21190a3c] +- Add example of using the transpose operator with multiple items in element (#4364) [0bce2be0] +- Add setting to enable the use of sync command [f0d5cc5c] +- Improve S3 endpoint validation [2b9ae6aa] +- Improve Wave config validation [7d5a21b0] +- Improve Wave error handling [d47e8b07] +- Fix Google Batch do not stop running jobs (#4381) [3d6b7358] +- Incorporate README content into Nextflow docs (#4263) [74a0f998] +- Never say (nearly) Oops again (#4356) [4a39542b] +- Remove unsupported K8s device capability [be0cf0c2] +- Remove unused -dsl2 option [3cb91a15] +- Rename Microsoft AAD to Microsoft Entra (#4362) [5e3f2c0a] +- Return -1 when exitcode file is empty (#4354) [d26c42be] +- Support for Fusion unprivileged execution (#4387) [035e6e7b] +- Use HistoryFile.Record instead of Record type conflic [11c3aac5] +- Bump nf-amazon@2.1.4 [a84208a8] +- Bump nf-cloudcache@0.3.0 [b37b4014] +- Bump nf-google@1.8.3 [b4eb8b96] +- Bump nf-tower@1.6.3 [5681ab13] +- Bump nf-wave@0.14.0 [de1de6c7] + +23.09.2-edge - 28 Sep 2023 +- Add conda.enabled to conda config scope docs (#4320) [0b74c4e2] +- Add developer docs (#4065) [06843d87] +- Add fs stat command [a79056b7] +- Add more tests to container name [da7a1942] +- Add procps by default to Conda-based Wave builds [66b2d2d2] +- Add support for Java 21 (#4338) [ac1fc9ee] +- Add Mermaid diagram in HTML DAG (#4337) [0f3e263f] +- Default Conda basePackages to "conda-forge::procps-ng" [367af52f] +- Disable Tower container field for multiple images [b53936b0] +- Document `NXF_DISABLE_CHECK_LATEST` environment var (#4327) [4e3e9aca] +- Document `fs` CLI command (#4328) [1a680495] +- Document source of `vol_ctxt` and `inv_ctxt` trace metrics (#4333) [6525b0a1] +- Document when process directives are evaluated (#4217) [731a29a2] +- Fix List of S3 bucket for custom endpoint [4327fa58] +- Fix Prevent false positive resumable task [144e0a8a] +- Fix Prevent multi attempts to retrieve AWS creds [b30efe36] +- Fix allow_other vulnerability preventing google-batch submissions (#4332) [9b3741e3] +- Fix fs list command [29ab2f24] +- Fix minor typos in changelogs/source code (#4319) [4ce9f1df] +- Fix support for S3 custom endpoint with anonymous access [03752815] +- Fix use of GITHUB_TOKEN variable to access GitHub repo [afe3dc4f] +- Fix Wave does not support 'null' container engine [f3eba3d7] +- Fix Retry TimeoutException in azure file system (#4295) [79248355] +- Improve K8s unit tests (#4196) [5a43a32b] +- Improve Mermaid DAG rendering (#4070) [19587f40] +- Improve error report when exception is thrown in operator ctx [16f54a9c] +- Improve wave container name validation [73eb5a02] +- Minor improvements [fff3d7bd] +- Prevent cache invalidation for task directives (#4339) [aabb6c19] +- Remove line endings from container box id (#4334) [df41e54a] +- Bump Apache 2.0 license to tower client [e4a878b6] +- Bump nf-amazon@2.1.3 [3311172f] +- Bump nf-azure@1.3.2 [a9b735ce] +- Bump nf-google@1.8.2 [7219d7f2] +- Bump nf-tower@1.6.2 [91a935f9] +- Bump nf-wave@0.13.0 [0cf2476c] +- Bump wave-utils@0.7.8 [d0c47d49] + +23.09.1-edge - 11 Sep 2023 +- Revert "Allow setting shell directive when using the trace file (#4210)" [9f9edcdc] + +23.09.0-edge - 10 Sep 2023 +- Add check for latest version (#4194) [3e8cd488] +- Add inspect command (#4069) [090c31ce] +- Add maxSubmitAwait (#3736) [5686bf1d] +- Add scripts logging for troubleshooting [c056a74e] +- Add support for Spack to Singularity builds [23c4ec1d] +- Add support for Wave native build for Singularity [8a434893] +- Add support for inputs and outputs arity [42504d3c] +- Add support for remote debug (#4266) [87e0648a] +- Add warning about using clusterOptions with process directives (#4248) [a68c1a3e] +- Add which to dockerfile build [817aa05b] +- Align Singularity experience with Docker (#4230) [a1e1d3ca] [c1cc60dd] +- Allow setting shell directive when using the trace file (#4210) [7d6ad624] +- Always emit publish event for cached task outputs (#4227) [62686ce8] +- Deprecated Wave report feature [80c5cb27] +- Disable staging script for remote work dir (#4282) [80f7cd46] +- Disable version check on CI tests [db79e13f] +- Docs improvement to clarify the usage of the bin dir (#4121) [2daa4172] +- Document API differences of process path inputs (#4189) [c37e00bc] +- Document use of local variables in closures (#4251) [05ff784a] +- Fix IOException should be thrown when failing to creare Azure directory [b0bdfd79] +- Fix Parallel execution of Conda corrupts data and packages (#4253) [976c282c] +- Fix Parse negative CLI params as numbers (#4238) [1ae70d5d] +- Fix Too long Http connection pool timeout [fa961e7f] +- Fix Wave build for Singularity files [a60ef72b] +- Fix Wave build when Conda package name is quoted [d19cb0b7] +- Fix failing test [2785ffe9] +- Fix fs cp command with remote file [366eedec] +- Fix printf command with negative exit code (#4213) [465468b0] +- Fix security deps in nf-azure plugin [c30d5211] +- Fix setting `executor.queueSize = 0` is ignored (#4228) [6664b578] +- Improve Wave handing of Conda envs [736ab9bb] +- Improve pod options documentation (#4274) [c3aa26e1] +- Make TraceRecord@store field public accessible [07582f0b] +- Remove -dsl1 and -dsl1 rub cli options [b6721b71] +- Remove experimental -dockerize option /2 [7def5542] +- Remove experimental -dockerize option [937c8fb7] +- Report an error on duplicate workflow name definitions (#4088) [fce9702e] +- Undocument internal NXF_DEBUG variable [7955db8d] +- Update AZ File share doc (#4235) [69d317b6] +- Update docs about splitCsv() operator (#4163) [1dfb621c] +- Update documentation of NXF_DEBUG (#4187) [a88a4245] +- Use sipHash24 in place of deprecated murmur32 for script aliasing [bb96763f] +- Bump groovy 3.0.19 [cb411208] +- Bump nf-amazon@2.1.2 [7e5d414e] +- Bump nf-azure@1.3.1 [83410f39] +- Bump nf-wave@0.12.0 [a9f6dd65] + +23.08.1-edge - 17 Aug 2023 +- Add 429 http status code to Wave retriable errors [8eb5f305] +- Add resource labels support for Azure Batch (#4178) [7b5e50a1] +- Apply K8s Pod metadata to Job (#4057) [4d918627] +- Document error about trailing backslash with space (#4180) [245afa5d] +- Enable cloud cache based on environment variable (#4160) [a66b0e63] +- Escape semicolons in paths (#4193) [552501ce] +- FIx nested InvocationTargetException (#4192) [67980f19] +- Fix Execution should fail if report or timeline file already exists [b238d7e2] +- Fix Process hangs when using flatten and finish errorStrategy [d99b3432] +- Fix `workflow.container` map resolution (#4190) [96ab8a69] +- Fix checkpoint thread termination (#4166) [2b449daa] +- Fix env output when changing task workdir [8e4d7fed] +- Fix if-guard on log.trace in trask processor inner class [50f6f6d5] +- Fix typos in source code comments (#4173) [e78bc37e] +- Improve Conda build error report [7b19fb03] +- Improve handling of name-only container env variables [3051cd13] +- Minor changes [7e58c945] +- Remove dockerize launcher classpath file (#4191) [2bae5198] +- Remove lock file from cloudcache (#4167) [6e6ea579] +- Update AWS instructions for creating a custom AMI (#4174) [563bff13] +- Update changelog [98f88a50] +- Update tip about modifying maps (#4153) [30036dbf] +- Use root user in Wave container based on micromamba (#4038) [a3a75ea2] +- Bump nf-azure@1.3.0 [6670bb06] +- Bump nf-cloudcache@0.2.0 [fb8f6681] +- Bump nf-tower@1.6.1 [d06b8365] +- Bump nf-wave@0.11.2 [7555b17d] + +23.08.0-edge - 5 Aug 2023 +- Add `-value` option to `config` command (#4142) [57e3100b] +- Add `deleteTasksOnCompletion` to Azure Batch configuration (#4114) [b14674dc] +- Add Tower logs checkpoint (#4132) [71dfecc2] +- Allow use virtual threads in Wave client [dd32f80a] +- Allow workflow entry from module import (#4128) [51f5c842] +- Disable cache backup/restore if cloudcache is used (#4125) [46e828e1] +- Document behavior of withName selector with included aliases (#4129) [8b7e3d48] +- Fix Option fixOwnership traverse parent directories [f2a2ea35] +- Fix Redirection http redirection across different hosts [fcdeec02] +- Fix Wave disable flag [8579e7a4] +- Fix bug with K8s resource labels (#4147) eu-west-1[3f4b8557] +- Fix glob resolution for remove files [19a72c40] +- Fix incorrect error message on missing comma (#4085) eu-west-1[a59af39f] +- Fix missing changelog for version 23.07.0-edge eu-west-1[9a33e936] +- Fix strict mode docs (#4150) [6b46b507] +- Improve plugin docs (#3957) [22638d46] +- Improve Wave config logging [547fad62] +- Improve TaskPollingMonitor logging [077ed5dd] +- Improve Wave and Fusion docs (#4149) [d2229bde] +- Increase Wave client max attempts [fe5dd497] +- Remove module all components import [a6d08c04] +- Restore Tower CacheManager for backward compatibility [6d269070] +- Bump amazoncorretto:17.0.8 [00eb145c] +- Bump nf-wave@0.11.1 [78e4b278] +- Bump nf-tower@1.6.0 [41c8c164] +- Bump nf-azure@1.2.0 [5f33ac17] +- Bump nf-amazon@2.1.1 [981315ad] + +23.07.0-edge - 23 Jul 2023 +- Add CPU model name to trace files and traceRecord (#3946) [e0d91bf7] +- Add ability to disable CLI params type detection [9a1c584d] +- Add cloudcache plugin (#4097) [ac90cc26] +- Add missing header to Wave container await [d39866e6] +- Add remote bin support for TES in a workdir (#3990) [8a22168a] +- Add retry logic to wave image await [9fc1d3bd] +- Add rule to build Nextflow docker image for ARM (#4020) [705d55f5] +- Add support for AWS SSO credentials provider (#4045) [53e33cde] +- Add support for Wave container freeze [9a5903e6] +- Add support legacy Wave retry [73a1e7d4] +- Allow SLURM executor option `--mem-per-cpu` (#4023) [96c04e3b] +- Allow disabling the Wave requirement when Fusion is enabled [9180d633] +- Disable Singularity and Apptainer home mount by default (#4056) [a0ee4657] +- Document `NXF_WRAPPER_STAGE_FILE_THRESHOLD` environment variable (#4113) [bda47567] +- Fix AzFileSystem retry policy [ba9b6d18] [c2f3cc96] +- Fix Improve error message for invalid Azure URI [0f4d8867] +- Fix Treat HTTP headers as case insensitive (#4116) [97fd3358] +- Fix invalid detection of hierarchical namespace stub blobs as files (#4046) [ce06c877] +- Fix stage script in Fusion script launcher (#4109) [0933f47e] +- Ignore accelerator type for AWS Batch (#4043) [263ecca8] +- Implement Weblog feature as an external plugin [f9f2c338] +- Improve "Unexpected input: '{'" error message (#4122) [ef9d3cf0] +- Improve Azure retry logging [de58697a] +- Improve description of channels and channel types (#4120) [8975734d] +- Improve handling Wave server errors [84f7a61a] +- Increase Azure min retry delay to 250ms [2e77e5e4] +- Remove default arch from wave request [f0e5c0c1] +- Remove logging of report JSON data (#4098) [099e5039] +- Wait for all child processes in nxf_parallel (#4050) [60a5f1a7] +- Bump Groovy 3.0.18 [207eb535] +- Bump micromamba 1.4.9 [6307f9b5] +- Bump nf-amazon@2.1.0 [57464746] +- Bump nf-azure@1.1.2 [e1512f6a] +- Bump nf-azure@1.1.3 [27e7f663] +- Bump nf-azure@1.1.4 [1895efc4] +- Bump nf-cloudcache@0.1.0 [cb6242c4] +- Bump nf-ga4gh@1.1.0 [f98feb77] +- Bump nf-google@1.8.1 [6aede7c0] +- Bump nf-tower@1.5.15 [3278d798] +- Bump nf-wave@0.11.0 [2998db5d] + +23.06.0-edge - 14 Jun 2023 +- Add AWS Kms integration test [19449bf4] +- Add Wave containers reports (preview) [9d9e2758] +- Add disk resource with type option for google batch (#3861) [166b3638] +- Add httpConnectTimeout and httpReadTimeout to Google options (#3974) [49fa15f7] +- Add plugin cmd help description [d3788f9f] +- Add retry policy on Az blob operations [295bc1ff] +- Add retry policy to Wave http client [1daebeef] +- Add support for AWS SES as mail sending provider [df85d443] +- Add support for arch auto-detection to Wave [7b5fdaf0] +- Add wave.httpClient.connectTimeout config option [dd999a3c] +- Clarify tip about groupTuple size and groupKey (#3949) [e60d327f] +- Consolidate Wave retryPolicy options [7d7464fe] +- Enhanced support for Spack + Wave (#3998) [63ac03b3] +- Fix Google Batch default instance family types (#3960) [b5257cd7] +- Fix S3 path normalization [b75ec444] +- Fix access to public S3 bucket when no creds are provided (#3992) [cf8ba466] [680f0a90] +- Fix containerOptions when using Fusion [dcde7b7f] +- Fix dump pretty print to not modify input (#3955) [46c17ee3] +- Fix invalid machine type setting when no valid machine type is found (#3961) [5eb93971] +- Fix matching symlink files [d63af784] +- Fix missing options for JsonSplitter creation (#3958) [f991fe9e] +- Fix non-deterministic null container engine error [f227f2e5] +- Fix packing all including Wave [735b8d9c] +- Fix static compiler errors [f48a473c] +- Improve documentation on Nextflow scripts (#3953) [80050c03] +- Improve description of channels and channel types (#4120) [8975734d] +- Improve "Unexpected input: '{'" error message (#4122) [ef9d3cf0] +- Minor change in Wave config [4da0442a] +- Prevent null exit code when Google batch is unable to access exit status [f68a39ec] +- Refactor Conda and Spack support for Wave to Java [36b9e226] +- Remove `--no-home` default option from charliecloud builder (#3956) [915074a4] +- Update workflow.revision max length to match the one in Tower (#4010) [1433a903] +- Bump amazocorretto:17.0.7 [c8aa1214] +- Bump azure-storage-blob:12.22.1 [2a36fa77] +- Bump nf-wave@0.11.0 [2998db5d] +- Bump nf-tower@1.5.15 [3278d798] +- Bump nf-google@1.8.1 [6aede7c0] +- Bump nf-ga4gh@1.1.0 [f98feb77] +- Bump nf-azure@1.1.4 [1895efc4] +- Bump nf-amazon@2.1.0 [57464746] +- Bump nf-cloudcache@0.1.0 [cb6242c4] + +23.05.0-edge - 15 May 2023 +- Add support for custom custom root directory to resolve relative paths (#3942) [f06bb1f7] +- Add `arch` directive support for Spack (#3786) [62dfc482] +- Add clone deep option to run and pull commands [b44b6453] +- Add fusion.exportStorageCredentials option [acb6aedf] +- Add groovy-yaml to core runtime [003e1f70] +- Add missing test env variables to CI build [a0e501bf] +- Add splitJson Operator (#3830) [4f58f695] +- Add support for Java 20 [3788a689] +- Add support for `time` directive in Azure Batch (#3869) [5c11a0d4] +- Add support for the Spack recipes to Wave build (#3636) [b03cbe70] +- Add Preview support for virtual threads (#3871) [5c429046] +- Convert docs to Markdown (#3196) [3cad402f] +- Deprecate DSL1 syntax for tap operator (#3004) [2be0edfe] +- Enable static compilation to missing classes (#3906) [c3c4b2f0] +- Fix -with-conda option in the docs (#3867) [9b350ba8] +- Fix AWS SSE env propagation to Fusion [e24608c3] +- Fix Apptainer rendering by removing superfluous space [36607ed1] +- Fix Azure jobs correctly deleted after completion (#3927) [b173a983] +- Fix Azure pool creation when using scaling formula (#3868) [79984a87] +- Fix DSL2 support in nextflow console (#3864) [0253f8d7] +- Fix K8s handling PodUnschedulableException (#3938) [5b756c63] +- Fix `interval` channel factory (#3848) [d001e4c7] +- Fix invalid warning on func import (#3807) [bb836960] +- Fix minor typo in nextflow subcommand (#3853) [dd3be3d1] +- Fix misleading error message on NoSuchFileException [f3dceba6] +- Fix missing SAS token fusion env for Azure [43015029] +- Fix problem args were not correctly represented in debug yaml (#3904) [eeb4b5c8] +- Fix string comparison in S3 client (#3875) [9344d294] +- Fix use of remote dir with local exec statement [850bc3d9] +- Fix Quote Singularity/Apptainer env values [586417ac] +- Improve handling default out param [91471970] +- Improve plugin test detection [29794bf4] +- Improve plugin updater err handling [f3d72f22] +- Improve task out redirect remove the use of mkfifo (#3863) [efedec74] +- Improve Use Docker stop instead of docker kill [32e6fd85] +- Improve Use separate script for long stage/unstage commands (#3851) [4343e333] +- Increase Azure default maxRetries to 10 [a017139f] +- Keep plugins-info content sorted [d5552ee6] +- Minor change on Docker-spack templates [e0e24bda] +- Refactor the AWS configuration (#3498) [a74e42d9] +- Remove `Channel.from` in favor of `Channel.of` from tests and docs (#3670) [aa8b72fa] +- Rename AmazonS3Client to S3Client [cc59596a] +- Rename com.upplication.s3fs package to nextflow.cloud.aws.nio [a2f3bb24] +- Run build CI tests on push to branches starting with `test*` or `dev*` (#3852) [7032e17c] +- Security fixes [973b7bea] +- Support enums in cache helper (#3901) [e4b977a4] +- Bump slf4j 2.0.7 and logback 1.4.6 [d7eae86e] +- Bump JGit 6.5 and use depth 1 when cloning repos [eda0845c] +- Bump aws-java-sdk-s3:1.12.429 [465171f5] +- Bump fusion 2.2 [f1ebe29a] +- Bump groovy 3.0.17 [cfe4ba56] +- Bump gson:2.10.1 [be555683] +- Bump micromamba:1.4.2 [334df1e0] +- Bump nf-wave@0.9.0 [7d6d0108] +- Bump nf-tower@1.5.13 [b06ffd0c] +- Bump nf-google@1.7.4 [2e0a15cd] +- Bump nf-ga4gh@1.0.6 [0c8fd7df] +- Bump nf-console@1.0.6 [a733b818] +- Bump nf-codecommit@0.1.5 [12edf0e6] +- Bump nf-amazon@2.0.0 [69b6edde] +- Bump nf-azure@1.1.0 [d05d51b4] diff --git a/changelog/nextflow/v23.10.1.mdx b/changelog/nextflow/v23.10.1.mdx new file mode 100644 index 000000000..17a314a6c --- /dev/null +++ b/changelog/nextflow/v23.10.1.mdx @@ -0,0 +1,20 @@ +--- +title: Nextflow v23.10.1 +date: 2024-01-12 +tags: [nextflow] +--- + +23.10.1 - 12 Jan 2023 +- Fix bug with Fusion symlink resolution (#4593) [f28c9e48] +- Fix Fusion symlinks when publishing files (#4348) [1fa5878a] +- Fix Inspect command fails with Singularity [25883df3] +- Fix Allow the use of error build-in function in onComplete handler (#4458) [ci fast] [4be10cd3] +- Fix Harden regular expression used to strip secrets in logs (#4563) [ci fast] [0102d4d6] +- Fix custom notification template [40980bcb] +- Fix container environment with special chars (#4594) [f4e00601] +- Fix AZURE_STORAGE_SAS_TOKEN environment variable (#4627) [2e1cb413] +- Fix azure retry policy (#4638) [2bc3cf0e] +- Fix BitBucket get source API with custom branch [5ef75e32] +- Improve error details for AbortOperationException [9e795a62] +- Bump nf-wave@1.0.1 [206f2614] +- Bump nf-azure@1.3.3 [50bcad59] diff --git a/changelog/nextflow/v23.10.2.mdx b/changelog/nextflow/v23.10.2.mdx new file mode 100644 index 000000000..10cf6a3f9 --- /dev/null +++ b/changelog/nextflow/v23.10.2.mdx @@ -0,0 +1,18 @@ +--- +title: Nextflow v23.10.2 +date: 2024-05-28 +tags: [nextflow] +--- + +- Update Platform API endpoint (#4855) [04cedce0] +- Fix semaphore in parallel polling monitor (#4927) [d173ceab] +- Fix security vulnerabilities (#5014) [a28b404c] +- Bump nf-wave@1.0.1-patch1 [3852dd1e] +- Bump nf-tower@1.6.3-patch1 [d692711b] +- Bump nf-google@1.8.3-patch1 [b48a1423] +- Bump nf-ga4gh@1.1.0-patch1 [911c1624] +- Bump nf-console@1.0.6-patch1 [9d6b64c3] +- Bump nf-codecommit@0.1.5-patch1 [f43964f8] +- Bump nf-cloudcache@0.3.3-patch1 [fb9059c7] +- Bump nf-azure@1.3.3-patch1 [8c398620] +- Bump nf-amazon@2.1.4-patch1 [1d3726db] diff --git a/changelog/nextflow/v23.10.3.mdx b/changelog/nextflow/v23.10.3.mdx new file mode 100644 index 000000000..91a118d81 --- /dev/null +++ b/changelog/nextflow/v23.10.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v23.10.3 +date: 2024-06-11 +tags: [nextflow] +--- + +- Bump nf-google@1.8.3-patch2 [6960daab] +- Bump nf-azure@1.3.3-patch2 [fbd3c1b4] +- Bump nf-amazon@2.1.4-patch2 [f5b95820] +- Fix security vulnerabilities (#5057) [6d8765b8] diff --git a/changelog/nextflow/v23.10.4.mdx b/changelog/nextflow/v23.10.4.mdx new file mode 100644 index 000000000..39180e95a --- /dev/null +++ b/changelog/nextflow/v23.10.4.mdx @@ -0,0 +1,14 @@ +--- +title: Nextflow v23.10.4 +date: 2024-07-31 +tags: [nextflow] +--- + +- Add docker launcher [474427a5] +- Update Azure batch deps [e0c6d77d] +- Bump nf-azure@1.3.3-patch3 [54683615] +- Bump nf-amazon@2.1.4-patch3 [084092f1] +- Bump nf-codecommit@0.1.5-patch2 [de43b17e] +- Bump amazon sdk to version 1.12.766 [189f58ed] +- Bump pf4j to version 3.12.0 [8dfa4076] +- Bump jgit 6.10.0 [4cf6b9f7] diff --git a/changelog/nextflow/v23.11.0-edge.mdx b/changelog/nextflow/v23.11.0-edge.mdx new file mode 100644 index 000000000..4bd86ec4c --- /dev/null +++ b/changelog/nextflow/v23.11.0-edge.mdx @@ -0,0 +1,63 @@ +--- +title: Nextflow v23.11.0-edge +date: 2023-11-24 +tags: [nextflow] +--- + +- Add `fusion.cacheSize` config option (#4518) [2faadc22] +- Add Topic channel type (experimental) (#4459) [921313d1] +- Add Google Batch native retry on spot termination (#4500) [ea1c1b70] +- Add Retry policy to Google Storage (#4524) [c271bb18] +- Add ability detect Google Batch spot interruption (#4462) [d49f02ae] +- Add doc tests, move some snippets to separate files (#3959) [0ff3b305] +- Add docs section on container requirements (#4501) [3fb29f78] +- Add labels field in Job request for Google Batch (#4538) [627c595e] +- Add note about limitations of glacier auto retrieval (#4514) [82e56799] +- Add note about local executor and enforcing resource limits (#4468) [6a0626f7] +- Add section about sharing modules (#4482) [3e66fba4] +- Add section on process directives to plugin docs (#4477) [d9ee9870] +- Add support for Azure low-priority pool (#4527) [8320ea10] +- Add support for FUSION_AWS_REGION (#4481) [8f8b09fa] +- Add support for Fusion when using Singularity OCI mode (#4508) [4f3aa631] +- Add support for K8s schedulerName pod spec (#4485) [ci fast] [dfc7b7c8] +- Add support for Singularity OCI mode (#4440) [f5362a7b] +- Allow the use of error built-in function in onComplete handler (#4458) [ci fast] [35a4424b] +- Fix Bug in JsonSplitter ordering [ci fast] [8ec14dd2] +- Fix Bypass Google Batch Price query if task cpus and memory are defined (#4521) [7f8f20d3] +- Fix Checkout remote tag if checkout remote branch fails (#4247) [b8907ccb] +- Fix Fusion symlinks when publishing files (#4348) [89f09fe0] +- Fix Inspect command fails with Singularity [f5bb829f] +- Fix ParamsMap copyWith param aliases (#4188) [b480ee0e] +- Fix Singularity docs [e952299f] +- Fix container hashing for Singularity + Wave containers [4c6f2e85] +- Fix detection of Conda local path made by Wave client [ci fast] (#4532) [4d5bc216] +- Fix doc tests to fail on test failure (#4505) [4d326551] +- Fix errors when NXF_HOME contains spaces (#4456) [ci fast] [fe5bea99] +- Fix Google Batch network/subnetwork docs (#4475) [27d132f3] +- Fix rounding error with long durations (#4496) [ci fast] [0356178b] +- Fix security vulnerabilities (#4513) [a310c777] +- Fix Use consistently NXF_TASK_WORKDIR (#4484) [48ee3c64] +- Improve error details for AbortOperationException [35609cb0] +- Improve operator docs (#4502) [38210e11] +- Makefile clean to also remove buildSrc/build (#4517) [2ccb05d0] +- Minor test improvements [ci fast] [171831ea] +- Minor types improvement for mix operator [ci fast] [91c1ab15] +- Normalise channel docs [b641d677] +- Remove deprecated TowerArchiver feature [ff8e06a3] +- Remove dsl1 deprecated code (part 2) [159effb1] +- Remove dsl1 deprecated code [2b433a52] +- Remove incorrect note about workflow inputs (#4509) [54bc0b7d] +- Return error if plugin version is not specified in offline mode (#4487) [f5d7246e] +- Update README.md with new branding color for Nextflow (#4412) [7a13b18b] +- Update background color of docs status badges (#4411) [3cb1c53c] +- Update logging filter for Google Batch provider. (#4488) [66a3ed19] +- Bump Gradle 8.4 and test vs Java 21 (#4450) [8cb2702c] +- Bump nf-amazon@2.2.0 [8e2d7879] +- Bump nf-azure@1.4.0 [7c47d090] +- Bump nf-cloudcache@0.3.1 [65240b75] +- Bump nf-codecommit@0.1.6 [725f0510] +- Bump nf-console@1.0.7 [a307686c] +- Bump nf-ga4gh@1.1.1 [e54ea007] +- Bump nf-google@1.9.0 [033ec92c] +- Bump nf-tower@1.7.0 [836a44a5] +- Bump nf-wave@1.1.0 [620523ef] diff --git a/changelog/nextflow/v23.12.0-edge.mdx b/changelog/nextflow/v23.12.0-edge.mdx new file mode 100644 index 000000000..f29840bcd --- /dev/null +++ b/changelog/nextflow/v23.12.0-edge.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v23.12.0-edge +date: 2023-12-20 +tags: [nextflow] +--- + +- Add AWS_SESSION_TOKEN to Fusion environment (#4581) [552f29b0] +- Add ability to disable Cloudinfo service (#4606) [f7251895] +- Add experimental support for Fargate compute type for AWS Batch (#3474) [47cf335b] +- Add support for Instance template to Google Batch [df7ed294] +- Add support for Singularity/Apptainer auto pull mode for OCI containers [b7f1a192] +- Fix BitBucket get source API with custom branch [58937831] +- Fix Fusion tags documentation (#4551) [687e2e96] +- Fix Harden regular expression to used to strip secrets in logs (#4563) [832bff24] +- Fix bug with Fusion symlink resolution (#4593) [09e85582] +- Fix container environment with special chars (#4594) [e0fe952f] +- Fix custom notification template [ccf4f59e] +- Fix fusion symlink test (#4604) [681ace86] +- Fix smoke tests [d3c2f330] +- Improve GLS tests [58590b1c] +- Load nf-amazon when AWS SES is enabled [887f06f4] +- Move build num & timestamp to BuildInfo class [ec8083d4] +- Move app version to BuildInfo class [c7d749e8] +- Remove deprecated Wave observer [0e009ef7] +- Remove undocumented userEmulation mode (#4596) [f6c79788] +- Remove unused DSL2 check [e9ee3b2c] +- Replace each iterator with class for [f7662e68] +- Bump nf-amazon@2.3.0 [0b40b7b9] +- Bump nf-google@1.10.0 [bcb20fcf] +- Bump nf-wave@1.2.0 [aa981814] +- Bump wave-utils@0.8.1 and micromamba@1.5.5 [9cb50035] +- Build optimizations (#4579) [5ad41e44] diff --git a/changelog/nextflow/v24.01.0-edge.mdx b/changelog/nextflow/v24.01.0-edge.mdx new file mode 100644 index 000000000..e2b8455a4 --- /dev/null +++ b/changelog/nextflow/v24.01.0-edge.mdx @@ -0,0 +1,38 @@ +--- +title: Nextflow v24.01.0-edge +date: 2024-02-05 +tags: [nextflow] +--- + +- Add support for custom fuse device plugin (#4612) [a1e33193] +- Fix Ignore stored process message when ansi log is enabled (#4645) [f9ba47ef] +- Fix Wave container replicable checksum [da382ddf] +- Fix azure retry policy (#4638) [85bab699] +- Fix handling of wave.s5cmdConfigUrl setting (#4707) [3a19386d] +- Fix typo in Hyperqueue section (#4635) [d5a6a963] +- Fix typo in OCI mode warning message (#4633) [e216a876] +- Fix typo in the docs (#4636) [ci-skip] [4727f174] +- Improve detection of sys home variable [8812138f] +- Improve handling of publish error (#4703) [fc9f7685] +- LocalSecretsProvider: invalid permissions tests made more robust (#4663) [682a6806] +- Remove Glacier auto-retrieval (#4705) [5f0ec50d] +- Remove preview from cmd secret [dc040226] +- Set scratch default to false when using Fusion (#4675) [9d17e407] +- Slight change in wording for error message about userEmulation (#4680) [a9c8a841] +- Truncate max size exceeded error message (#4644) [36090b70] +- Use AZURE_STORAGE_SAS_TOKEN environment variable (#4627) [2e02afbf] +- Use canonical init method for plugins initialization [e7a20aff] +- Bump nf-wave@1.3.0 [8b9905c7] +- Bump nf-tower@1.8.0 [bfc94e46] +- Bump nf-google@1.11.0 [01ff0353] +- Bump nf-ga4gh@1.2.0 [3df34188] +- Bump nf-console@1.1.0 [e90d73a7] +- Bump nf-codecommit@0.2.0 [4379c941] +- Bump nf-cloudcache@0.4.0 [2bc698c7] +- Bump nf-azure@1.5.0 [07415ce1] +- Bump nf-amazon@2.4.0 [b991e14b] +- Bump Groovy 4 (#4443) [ci fast] [9d32503b] +- Bump actions/checkout@v4 [d1b3195e] +- Bump logback@1.4.12 + guava@33.0.0-jre [331ff425] +- Bump nextflow 23.12.0-edge as min version [63e83702] +- Bump tj-actions/changed-files from 35 to 41 in /.github/workflows (#4622) [d67aef5f] diff --git a/changelog/nextflow/v24.02.0-edge.mdx b/changelog/nextflow/v24.02.0-edge.mdx new file mode 100644 index 000000000..a233db371 --- /dev/null +++ b/changelog/nextflow/v24.02.0-edge.mdx @@ -0,0 +1,34 @@ +--- +title: Nextflow v24.02.0-edge +date: 2024-03-10 +tags: [nextflow] +--- + +- Add K8s job ttlSecondsAfterFinished option (#4434) [93627be6] +- Add NXF_CACHE_DIR environment var (#4655) [4b00170a] +- Add colours to ansi logs (#4573) [5e2ce9ed] +- Add eval output type (#4493) [df978113] +- Fix Always emit publish event for symlinks on resume (#4790) [bb5c4f9d] +- Fix Do not create local plugin path in embedded mode [9d6dd6a0] +- Fix Error while publishing S3 file with blanks [b74c0227] +- Fix Missing dependency for console command [baf29110] +- Fix typo in Azure Batch docs ('Azore') (#4735) [192bf8df] +- Fix typo in error message [a7f23305] +- Remove experimental admonition for podman [17d0dced] +- Remove square brackets from job name in LSF executor (#4799) [6e0ac72d] +- Remove unneeded const [09c957fb] +- Rename Tower -> Seqera Platform in docs and log messages (#4727) [7caffef9] +- Update Azure dependencies [1bcbaf0d] +- Update copyright info [e3089f0e] +- Use alias for HistoryFile.Record [17217a1c] +- minor cli docstring fix (#4759) [ee4b4a25] +- Bump Grengine 3.0.2 [42ca2b6f] +- Bump groovy 4.0.19 [854dc1f0] +- Bump snakeyaml 2.2 [07480779] +- Bump nf-amazon@2.4.1 [0eb84071] +- Bump nf-azure@1.5.1 [d63be8c0] +- Bump nf-cloudcache@0.4.1 [57b7004e] +- Bump nf-console@1.1.1 [b7f703f5] +- Bump nf-tower@1.8.1 [b8ffb180] +- Bump nf-wave@1.3.1 [0c542eda] +- Bump amazoncorretto 17.0.10-al2023 [3e695ad9] diff --git a/changelog/nextflow/v24.03.0-edge.mdx b/changelog/nextflow/v24.03.0-edge.mdx new file mode 100644 index 000000000..f18327983 --- /dev/null +++ b/changelog/nextflow/v24.03.0-edge.mdx @@ -0,0 +1,44 @@ +--- +title: Nextflow v24.03.0-edge +date: 2024-04-15 +tags: [nextflow] +--- + +- Add custom jobName for Google Batch [df40d55f] +- Add escher to name generator class [2e6496e2] +- Add retry policy to Google Batch client [c4981dcc] +- Add retry strategy for publishing (#4839) [c9c7032c] +- Add support for Azure custom startTask (#4913) [27d01e3a] +- Add task tip extension point [eadad5b8] +- Allow secrets to be used in pipeline script (#4171) [df866a24] +- Do not print a new line when stdout is empty (#4892) [658a5ec8] +- Fix Azure pool creation [2ee4d11e] +- Fix Use of secrets in the includeConfig path [00c9f226] +- Fix coloured ANSI log bug (#4898) [a04d6983] +- Fix eval output type via bash -c wrapping (#4887) [2165a14d] +- Fix exception handling in local executor [74d7d7a8] +- Fix support for GCS requester pays bucket option [d9d61cff] +- Fix test when missing Google secret [33dc3ce0] +- Improve Charliecloud support (#4879) [287471c0] +- Improve control on azcopy install (#4883) [01447d5c] +- Improve error message when Google creds file is corrupted [a550e52f] +- Improve getting started docs (#4764) [b59111b3] +- Improve retry logic for AWS Batch executor [62926c28] +- Nextflow launch script: improving search for JAVA_CMD (#4830) [ebbbe9e7] +- Publish built-in reports as Tower reports (#4760) [b710d923] +- Remove not needed dsl=2 + error in example (#4812) [7c5779d7] +- Remove unused code from AssetManager [77365165] +- Revert "Fix failing CI tests (#4861)" [7ba2e253] +- Update NameGenerator (#4907) [248201af] +- Update Platform API endpoint (#4855) [4842423a] +- Update Wave to API v1alpha2 (#4906) [9c350872] +- Update docs (#4852) [6e2d1a94] +- Updated docs on Google Cloud setup and credentials (#4896) [7e8b5e26] +- Updated dodcs note on singularity default command (#4825) [567f5334] +- Bump groovy 4.0.20 [66c1a164] +- Bump groovy 4.0.21 [9e08390b] +- Bump nf-wave@1.4.0 [fc70dc8c] +- Bump nf-tower@1.9.0 [b0c4e2c5] +- Bump nf-google@1.12.0 [6ae25fad] +- Bump nf-azure@1.6.0 [967c2ac8] +- Bump nf-amazon@2.4.2 [ddda969e] diff --git a/changelog/nextflow/v24.04.0-edge.mdx b/changelog/nextflow/v24.04.0-edge.mdx new file mode 100644 index 000000000..05008b173 --- /dev/null +++ b/changelog/nextflow/v24.04.0-edge.mdx @@ -0,0 +1,54 @@ +--- +title: Nextflow v24.04.0-edge +date: 2024-05-13 +tags: [nextflow] +--- + +- Add Wave and Fusion info to workflow metadata (#4945) [bb7e1c8e] +- Add `k8s.cpuLimits` config option (#3027) [3c6e96d0] +- Add account config option for grid executors (#4975) [a09e37dd] +- Add git to docs deps [aa9e1273] +- Add resourceLimits directive (#2911) [7c9d965e] +- Add support for Job arrays (#3892) [ca9bc9d4] +- Add support for clusterOptions as a list of values (#4993) [dd173e33] +- Add threads dump for troubleshooting purposes [8992ebde] +- Fix Gstring casting exception when clusterOptions is a closure [74004fbd] +- Fix Missing error code when no entry is specified [f507e9a4] +- Fix NPE in LogsCheckpoint class [deb3076d] +- Fix Prevent maxForks less than zero [7676dd9c] +- Fix Use fully qualified S3 uris in error message (#4923) [f1cffd1b] +- Fix Wave container resolution with singularity and ociMode [54ad6241] +- Fix collectFile saving to GCS with sort: false (#4965) [1418553a] +- Fix console "Plugin manager not initialised" warn (#4989) [5ff44538] +- Fix console icon (#4991) [b8a23706] +- Fix docs formatting [c02e58c7] +- Fix docs snippet [6499649d] +- Fix flaky docs test (#4957) [ea8246f6] +- Fix groovy console issue (#4988) [b9bf6410] +- Fix job array docs (#4984) [6a3347ee] +- Fix missing include error message (#4981) [aad100e1] +- Fix script error text alignment (#4681) [1dc4e4e4] +- Fix security vulnerability in logback (#4947) [0ffcc4ca] +- Fix semaphore in parallel polling monitor (#4927) [5c37fcc2] +- Fix remove commented out test lines in Azure Batch Pool opts tests. (#4914) [cb607f07] +- Guarantees K8s pod name is unique on resume (#4959) [361cef84] +- Improve config resolution docs (#4950) [019eb86c] +- Improve documentation about azcopy installation requirements for custom Azure Batch worker pools (#4911) [5c410db8] +- Improve error message for image pull time-out for Singularity/Apptainer/Charliecloud (#4974) [73015fbd] +- Remove unused const [6e91285d] +- Run task finalisation asynchronously (#4890) [e0e94227] +- Strip auth secret from logs [acf63e0e] +- Update TES executor to TES API v1.1 (#4195) [7b32c2d6] +- Update aws.md to include Cluster access (#4951) [459d725b] +- Update developer diagrams (#4922) [dcff41a5] +- Update operator return types (#4976) [a614fbe7] +- Update stale documentation in overview.md (#4968) [6a58c6d7] +- Use for instead eachLine in error formatting [4a821f46] +- azure batch autopool feature more comprehensive documentation (#4941) [adbd8903] +- Bump Gradle 8.7 [8b5cf3cc] +- Bump nf-wave@1.4.1 [830b032c] +- Bump nf-tower@1.9.1 [163683c2] +- Bump nf-google@1.13.0 [6d99a22a] +- Bump nf-ga4gh@1.3.0 [89695ed3] +- Bump nf-console@1.1.2 [357b143a] +- Bump nf-amazon@2.5.0 [6c62a60a diff --git a/changelog/nextflow/v24.04.0.mdx b/changelog/nextflow/v24.04.0.mdx new file mode 100644 index 000000000..0a3a75901 --- /dev/null +++ b/changelog/nextflow/v24.04.0.mdx @@ -0,0 +1,263 @@ +--- +title: Nextflow v24.04.0 +date: 2024-05-20 +tags: [nextflow] +--- + +- Add 'preview' to workflow runtime metadata (#4985) [935bb1e5] +- Add enabled property to output dsl (#5008) [284415b1] +- Fix Taskbar API is not supported error [0ea09ccc] +- Fix inspect should not write history entry [c713ad51] +- Fix unexpected container resolution [a5ecf8a4] +- Improve icon loading error handling [c72e16f8] +- Remove Fusion symlink resolution (#5004) [071ea74c] +- Remove `seqera` and `defaults` from Conda default channels (#5003) [ec5ebd0b] +- Use protected visibility for updateStatus method [6871ba06] +- Workflow output definition (#4784) [cf0546b1] +- Bump Fusion 2.3 (#5005) [7176c113] +- Bump groovy-console 4.0.21-patch.2 [eb97831f] +- Bump nf-amazon@2.5.1 [96ee633d] +- Bump nf-console@1.1.3 [e8359042] +- Bump nf-google@1.13.1 [5dcb4c7a] +- Bump nf-wave@1.4.2 [73c668a6] + +24.04.0-edge - 13 May 2024 +- Add Wave and Fusion info to workflow metadata (#4945) [bb7e1c8e] +- Add `k8s.cpuLimits` config option (#3027) [3c6e96d0] +- Add account config option for grid executors (#4975) [a09e37dd] +- Add git to docs deps [aa9e1273] +- Add resourceLimits directive (#2911) [7c9d965e] +- Add support for Job arrays (#3892) [ca9bc9d4] +- Add support for clusterOptions as a list of values (#4993) [dd173e33] +- Add threads dump for troubleshooting purposes [8992ebde] +- Fix Gstring casting exception when clusterOptions is a closure [74004fbd] +- Fix Missing error code when no entry is specified [f507e9a4] +- Fix NPE in LogsCheckpoint class [deb3076d] +- Fix Prevent maxForks less than zero [7676dd9c] +- Fix Use fully qualified S3 uris in error message (#4923) [f1cffd1b] +- Fix Wave container resolution with singularity and ociMode [54ad6241] +- Fix collectFile saving to GCS with sort: false (#4965) [1418553a] +- Fix console "Plugin manager not initialised" warn (#4989) [5ff44538] +- Fix console icon (#4991) [b8a23706] +- Fix docs formatting [c02e58c7] +- Fix docs snippet [6499649d] +- Fix flaky docs test (#4957) [ea8246f6] +- Fix groovy console issue (#4988) [b9bf6410] +- Fix job array docs (#4984) [6a3347ee] +- Fix missing include error message (#4981) [aad100e1] +- Fix script error text alignment (#4681) [1dc4e4e4] +- Fix security vulnerability in logback (#4947) [0ffcc4ca] +- Fix semaphore in parallel polling monitor (#4927) [5c37fcc2] +- Fix remove commented out test lines in Azure Batch Pool opts tests. (#4914) [cb607f07] +- Guarantees K8s pod name is unique on resume (#4959) [361cef84] +- Improve config resolution docs (#4950) [019eb86c] +- Improve documentation about azcopy installation requirements for custom Azure Batch worker pools (#4911) [5c410db8] +- Improve error message for image pull time-out for Singularity/Apptainer/Charliecloud (#4974) [73015fbd] +- Remove unused const [6e91285d] +- Run task finalisation asynchronously (#4890) [e0e94227] +- Strip auth secret from logs [acf63e0e] +- Update TES executor to TES API v1.1 (#4195) [7b32c2d6] +- Update aws.md to include Cluster access (#4951) [459d725b] +- Update developer diagrams (#4922) [dcff41a5] +- Update operator return types (#4976) [a614fbe7] +- Update stale documentation in overview.md (#4968) [6a58c6d7] +- Use for instead eachLine in error formatting [4a821f46] +- azure batch autopool feature more comprehensive documentation (#4941) [adbd8903] +- Bump Gradle 8.7 [8b5cf3cc] +- Bump nf-wave@1.4.1 [830b032c] +- Bump nf-tower@1.9.1 [163683c2] +- Bump nf-google@1.13.0 [6d99a22a] +- Bump nf-ga4gh@1.3.0 [89695ed3] +- Bump nf-console@1.1.2 [357b143a] +- Bump nf-amazon@2.5.0 [6c62a60a] + +24.03.0-edge - 15 Apr 2024 +- Add custom jobName for Google Batch [df40d55f] +- Add escher to name generator class [2e6496e2] +- Add retry policy to Google Batch client [c4981dcc] +- Add retry strategy for publishing (#4839) [c9c7032c] +- Add support for Azure custom startTask (#4913) [27d01e3a] +- Add task tip extension point [eadad5b8] +- Allow secrets to be used in pipeline script (#4171) [df866a24] +- Do not print a new line when stdout is empty (#4892) [658a5ec8] +- Fix Azure pool creation [2ee4d11e] +- Fix Use of secrets in the includeConfig path [00c9f226] +- Fix coloured ANSI log bug (#4898) [a04d6983] +- Fix eval output type via bash -c wrapping (#4887) [2165a14d] +- Fix exception handling in local executor [74d7d7a8] +- Fix support for GCS requester pays bucket option [d9d61cff] +- Fix test when missing Google secret [33dc3ce0] +- Improve Charliecloud support (#4879) [287471c0] +- Improve control on azcopy install (#4883) [01447d5c] +- Improve error message when Google creds file is corrupted [a550e52f] +- Improve getting started docs (#4764) [b59111b3] +- Improve retry logic for AWS Batch executor [62926c28] +- Nextflow launch script: improving search for JAVA_CMD (#4830) [ebbbe9e7] +- Publish built-in reports as Tower reports (#4760) [b710d923] +- Remove not needed dsl=2 + error in example (#4812) [7c5779d7] +- Remove unused code from AssetManager [77365165] +- Revert "Fix failing CI tests (#4861)" [7ba2e253] +- Update NameGenerator (#4907) [248201af] +- Update Platform API endpoint (#4855) [4842423a] +- Update Wave to API v1alpha2 (#4906) [9c350872] +- Update docs (#4852) [6e2d1a94] +- Updated docs on Google Cloud setup and credentials (#4896) [7e8b5e26] +- Updated dodcs note on singularity default command (#4825) [567f5334] +- Bump groovy 4.0.20 [66c1a164] +- Bump groovy 4.0.21 [9e08390b] +- Bump nf-wave@1.4.0 [fc70dc8c] +- Bump nf-tower@1.9.0 [b0c4e2c5] +- Bump nf-google@1.12.0 [6ae25fad] +- Bump nf-azure@1.6.0 [967c2ac8] +- Bump nf-amazon@2.4.2 [ddda969e] + +24.02.0-edge - 10 Mar 2024 +- Add K8s job ttlSecondsAfterFinished option (#4434) [93627be6] +- Add NXF_CACHE_DIR environment var (#4655) [4b00170a] +- Add colours to ansi logs (#4573) [5e2ce9ed] +- Add eval output type (#4493) [df978113] +- Fix Always emit publish event for symlinks on resume (#4790) [bb5c4f9d] +- Fix Do not create local plugin path in embedded mode [9d6dd6a0] +- Fix Error while publishing S3 file with blanks [b74c0227] +- Fix Missing dependency for console command [baf29110] +- Fix typo in Azure Batch docs ('Azore') (#4735) [192bf8df] +- Fix typo in error message [a7f23305] +- Remove experimental admonition for podman [17d0dced] +- Remove square brackets from job name in LSF executor (#4799) [6e0ac72d] +- Remove unneeded const [09c957fb] +- Rename Tower -> Seqera Platform in docs and log messages (#4727) [7caffef9] +- Update Azure dependencies [1bcbaf0d] +- Update copyright info [e3089f0e] +- Use alias for HistoryFile.Record [17217a1c] +- minor cli docstring fix (#4759) [ee4b4a25] +- Bump Grengine 3.0.2 [42ca2b6f] +- Bump groovy 4.0.19 [854dc1f0] +- Bump snakeyaml 2.2 [07480779] +- Bump nf-amazon@2.4.1 [0eb84071] +- Bump nf-azure@1.5.1 [d63be8c0] +- Bump nf-cloudcache@0.4.1 [57b7004e] +- Bump nf-console@1.1.1 [b7f703f5] +- Bump nf-tower@1.8.1 [b8ffb180] +- Bump nf-wave@1.3.1 [0c542eda] +- Bump amazoncorretto 17.0.10-al2023 [3e695ad9] + +24.01.0-edge - 5 Feb 2024 +- Add support for custom fuse device plugin (#4612) [a1e33193] +- Fix Ignore stored process message when ansi log is enabled (#4645) [f9ba47ef] +- Fix Wave container replicable checksum [da382ddf] +- Fix azure retry policy (#4638) [85bab699] +- Fix handling of wave.s5cmdConfigUrl setting (#4707) [3a19386d] +- Fix typo in Hyperqueue section (#4635) [d5a6a963] +- Fix typo in OCI mode warning message (#4633) [e216a876] +- Fix typo in the docs (#4636) [ci-skip] [4727f174] +- Improve detection of sys home variable [8812138f] +- Improve handling of publish error (#4703) [fc9f7685] +- LocalSecretsProvider: invalid permissions tests made more robust (#4663) [682a6806] +- Remove Glacier auto-retrieval (#4705) [5f0ec50d] +- Remove preview from cmd secret [dc040226] +- Set scratch default to false when using Fusion (#4675) [9d17e407] +- Slight change in wording for error message about userEmulation (#4680) [a9c8a841] +- Truncate max size exceeded error message (#4644) [36090b70] +- Use AZURE_STORAGE_SAS_TOKEN environment variable (#4627) [2e02afbf] +- Use canonical init method for plugins initialization [e7a20aff] +- Bump nf-wave@1.3.0 [8b9905c7] +- Bump nf-tower@1.8.0 [bfc94e46] +- Bump nf-google@1.11.0 [01ff0353] +- Bump nf-ga4gh@1.2.0 [3df34188] +- Bump nf-console@1.1.0 [e90d73a7] +- Bump nf-codecommit@0.2.0 [4379c941] +- Bump nf-cloudcache@0.4.0 [2bc698c7] +- Bump nf-azure@1.5.0 [07415ce1] +- Bump nf-amazon@2.4.0 [b991e14b] +- Bump Groovy 4 (#4443) [9d32503b] +- Bump actions/checkout@v4 [d1b3195e] +- Bump logback@1.4.12 + guava@33.0.0-jre [331ff425] +- Bump nextflow 23.12.0-edge as min version [63e83702] +- Bump tj-actions/changed-files from 35 to 41 in /.github/workflows (#4622) [d67aef5f] + +23.12.0-edge - 20 Dec 2023 +- Add AWS_SESSION_TOKEN to Fusion environment (#4581) [552f29b0] +- Add ability to disable Cloudinfo service (#4606) [f7251895] +- Add experimental support for Fargate compute type for AWS Batch (#3474) [47cf335b] +- Add support for Instance template to Google Batch [df7ed294] +- Add support for Singularity/Apptainer auto pull mode for OCI containers [b7f1a192] +- Fix BitBucket get source API with custom branch [58937831] +- Fix Fusion tags documentation (#4551) [687e2e96] +- Fix Harden regular expression to used to strip secrets in logs (#4563) [832bff24] +- Fix bug with Fusion symlink resolution (#4593) [09e85582] +- Fix container environment with special chars (#4594) [e0fe952f] +- Fix custom notification template [ccf4f59e] +- Fix fusion symlink test (#4604) [681ace86] +- Fix smoke tests [d3c2f330] +- Improve GLS tests [58590b1c] +- Load nf-amazon when AWS SES is enabled [887f06f4] +- Move build num & timestamp to BuildInfo class [ec8083d4] +- Move app version to BuildInfo class [c7d749e8] +- Remove deprecated Wave observer [0e009ef7] +- Remove undocumented userEmulation mode (#4596) [f6c79788] +- Remove unused DSL2 check [e9ee3b2c] +- Replace each iterator with class for [f7662e68] +- Bump nf-amazon@2.3.0 [0b40b7b9] +- Bump nf-google@1.10.0 [bcb20fcf] +- Bump nf-wave@1.2.0 [aa981814] +- Bump wave-utils@0.8.1 and micromamba@1.5.5 [9cb50035] +- Build optimizations (#4579) [5ad41e44] + +23.11.0-edge - 24 Nov 2023 +- Add `fusion.cacheSize` config option (#4518) [2faadc22] +- Add Topic channel type (experimental) (#4459) [921313d1] +- Add Google Batch native retry on spot termination (#4500) [ea1c1b70] +- Add Retry policy to Google Storage (#4524) [c271bb18] +- Add ability detect Google Batch spot interruption (#4462) [d49f02ae] +- Add doc tests, move some snippets to separate files (#3959) [0ff3b305] +- Add docs section on container requirements (#4501) [3fb29f78] +- Add labels field in Job request for Google Batch (#4538) [627c595e] +- Add note about limitations of glacier auto retrieval (#4514) [82e56799] +- Add note about local executor and enforcing resource limits (#4468) [6a0626f7] +- Add section about sharing modules (#4482) [3e66fba4] +- Add section on process directives to plugin docs (#4477) [d9ee9870] +- Add support for Azure low-priority pool (#4527) [8320ea10] +- Add support for FUSION_AWS_REGION (#4481) [8f8b09fa] +- Add support for Fusion when using Singularity OCI mode (#4508) [4f3aa631] +- Add support for K8s schedulerName pod spec (#4485) [dfc7b7c8] +- Add support for Singularity OCI mode (#4440) [f5362a7b] +- Allow the use of error built-in function in onComplete handler (#4458) [35a4424b] +- Fix Bug in JsonSplitter ordering [8ec14dd2] +- Fix Bypass Google Batch Price query if task cpus and memory are defined (#4521) [7f8f20d3] +- Fix Checkout remote tag if checkout remote branch fails (#4247) [b8907ccb] +- Fix Fusion symlinks when publishing files (#4348) [89f09fe0] +- Fix Inspect command fails with Singularity [f5bb829f] +- Fix ParamsMap copyWith param aliases (#4188) [b480ee0e] +- Fix Singularity docs [e952299f] +- Fix container hashing for Singularity + Wave containers [4c6f2e85] +- Fix detection of Conda local path made by Wave client (#4532) [4d5bc216] +- Fix doc tests to fail on test failure (#4505) [4d326551] +- Fix errors when NXF_HOME contains spaces (#4456) [fe5bea99] +- Fix Google Batch network/subnetwork docs (#4475) [27d132f3] +- Fix rounding error with long durations (#4496) [0356178b] +- Fix security vulnerabilities (#4513) [a310c777] +- Fix Use consistently NXF_TASK_WORKDIR (#4484) [48ee3c64] +- Improve error details for AbortOperationException [35609cb0] +- Improve operator docs (#4502) [38210e11] +- Makefile clean to also remove buildSrc/build (#4517) [2ccb05d0] +- Minor test improvements [171831ea] +- Minor types improvement for mix operator [91c1ab15] +- Normalise channel docs [b641d677] +- Remove deprecated TowerArchiver feature [ff8e06a3] +- Remove dsl1 deprecated code (part 2) [159effb1] +- Remove dsl1 deprecated code [2b433a52] +- Remove incorrect note about workflow inputs (#4509) [54bc0b7d] +- Return error if plugin version is not specified in offline mode (#4487) [f5d7246e] +- Update README.md with new branding color for Nextflow (#4412) [7a13b18b] +- Update background color of docs status badges (#4411) [3cb1c53c] +- Update logging filter for Google Batch provider. (#4488) [66a3ed19] +- Bump Gradle 8.4 and test vs Java 21 (#4450) [8cb2702c] +- Bump nf-amazon@2.2.0 [8e2d7879] +- Bump nf-azure@1.4.0 [7c47d090] +- Bump nf-cloudcache@0.3.1 [65240b75] +- Bump nf-codecommit@0.1.6 [725f0510] +- Bump nf-console@1.0.7 [a307686c] +- Bump nf-ga4gh@1.1.1 [e54ea007] +- Bump nf-google@1.9.0 [033ec92c] +- Bump nf-tower@1.7.0 [836a44a5] +- Bump nf-wave@1.1.0 [620523ef] diff --git a/changelog/nextflow/v24.04.1.mdx b/changelog/nextflow/v24.04.1.mdx new file mode 100644 index 000000000..0f4bee878 --- /dev/null +++ b/changelog/nextflow/v24.04.1.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v24.04.1 +date: 2024-05-20 +tags: [nextflow] +--- + +- Fix nf-google plugin dependency [725e2860] +- Fix nf-amazon plugin dependency [c234b09f] +- Bump nf-google@1.13.2 [633989a6] +- Bump nf-amazon@2.5.2 [e31f70e0] diff --git a/changelog/nextflow/v24.04.2.mdx b/changelog/nextflow/v24.04.2.mdx new file mode 100644 index 000000000..0a757076b --- /dev/null +++ b/changelog/nextflow/v24.04.2.mdx @@ -0,0 +1,12 @@ +--- +title: Nextflow v24.04.2 +date: 2024-05-29 +tags: [nextflow] +--- + +- Fix handling of tags with slash on Bitbucket (#5031) [ci fast] [76cd305f] +- Fix the default for async finalizer (#5013) [f5fba709] +- Fix the invocation of function with gstring (#5020) [04317f0d] +- Fix escapes dollar char in local secret provider (#5021) [d8f8bf56] +- Improve Charliecloud registry handling (#5018) [ci fast] [42496dbc] +- Enable the use of Java 22 (#4970) [ci fast] [cbf24f9b] diff --git a/changelog/nextflow/v24.04.3.mdx b/changelog/nextflow/v24.04.3.mdx new file mode 100644 index 000000000..6ac730b51 --- /dev/null +++ b/changelog/nextflow/v24.04.3.mdx @@ -0,0 +1,10 @@ +--- +title: Nextflow v24.04.3 +date: 2024-07-09 +tags: [nextflow] +--- + +- Add ability to override failOnError setting default via env variable (#5117) [ci fast] [6852429c] +- Fix normalization of consecutive slashes in uri path (#5114) [3f366b7e] +- Fix executions hangs on finalisation exception (#5070) [4c207c23] +- Bump nf-google@1.13.2-patch1 [55ec5ec5] diff --git a/changelog/nextflow/v24.05.0-edge.mdx b/changelog/nextflow/v24.05.0-edge.mdx new file mode 100644 index 000000000..bcc9ce784 --- /dev/null +++ b/changelog/nextflow/v24.05.0-edge.mdx @@ -0,0 +1,32 @@ +--- +title: Nextflow v24.05.0-edge +date: 2024-06-17 +tags: [nextflow] +--- + +- Add Managed Identity to Azure authentication documentation (#5062) [ab5b3eb2] +- Add support for Azure managed identity (#4897) [21ca16e6] +- Add support for EC-encrypted private keys for K8s executor [4dbb5193] +- Add workflow.failOnIgnore config option (#4686) [ci fast] [172edc38] +- Allow requester pays for S3 buckets (#5027) [0070c1b0] +- Dump threads on abort condition [e3740977] +- Enable build with Java 21 (#5030) [4c54db6a] +- Fix Azure system-assigned managed identity [a639a17d] +- Fix Java 22 version in launcher [29d6f1df] +- Fix executions hangs on finalisation exception (#5070) [38434b82] +- Fix support for Azure managed identity clientId [306814e7] +- Fix support for s5cmd 2.2.2 (#5069) [7e78bd4d] +- Fix the cleanup of local secret file (#5061) [e28537ca] +- Fix typo in error message [f5c2355b] +- Fix unique operator hangs when applied to value (#5053) [88b8ab0c] +- Improve retry strategy for Google cloud errors when writing task helper files (#5037) [f8b324ab] +- Remove GA4GH plugin (#5056) [0471b2e1] +- Remove ending slashes for publish targets [891ed117] +- Bump Gradle 8.8 final [ee54606c] +- Bump aws-sdk 1.12.740 [acad2a1f] +- Bump azure-compute-batch:1.0.0-beta.2 [c08dc49b] +- Bump azure-storage-blob 12.26.1 [c76ff5e7] +- Bump nf-wave@1.4.3 [01922f13] +- Bump nf-google@1.13.3 [c064d209] +- Bump nf-azure@1.7.0 [eeca7d67] +- Bump nf-amazon@2.6.0 [d3f53c19] diff --git a/changelog/nextflow/v24.06.0-edge.mdx b/changelog/nextflow/v24.06.0-edge.mdx new file mode 100644 index 000000000..0221a0872 --- /dev/null +++ b/changelog/nextflow/v24.06.0-edge.mdx @@ -0,0 +1,19 @@ +--- +title: Nextflow v24.06.0-edge +date: 2024-07-08 +tags: [nextflow] +--- + +- Add ability to override failOnError setting default via env variable (#5117) [72d78425] +- Add retry options to Azure Blob client (#5098) [7d5e5d2b] +- Add support for HyperQueue 0.17.0 or later [BREAKING] [b45f7c48] +- Adds example of error strategies to documentation (#5121) [e82b0dee] +- Fix docs for `failOnDuplicate` and `failOnMismatch` (#5113) [7d5c4824] +- Fix normalization of consecutive slashes in uri path (#5114) [18ec484f] +- Update Azure VMs and regions for 2024-07-01 (#5100) [12b027ee] +- Bump Fusion 2.4 (#5080) [0a8a484e] +- Bump Groovy 4.0.22 [284a6606] +- Bump nf-azure@1.8.0 [28122b70] +- Bump nf-google@1.13.4 [a1c2a814] +- Bump nf-wave@1.4.4 [a3dfba54] +- Bump amazoncorretto:17-al2023 to Dockerfile [5e03a7b7] diff --git a/changelog/nextflow/v24.07.0-edge.mdx b/changelog/nextflow/v24.07.0-edge.mdx new file mode 100644 index 000000000..a5d660199 --- /dev/null +++ b/changelog/nextflow/v24.07.0-edge.mdx @@ -0,0 +1,44 @@ +--- +title: Nextflow v24.07.0-edge +date: 2024-08-05 +tags: [nextflow] +--- + +- Add runtime error for missing channel factory (#5170) [1f9210ab] +- Apply k8s.cpuLimits to kuberun driver pod (#5160) [4300adf1] +- Await build completion for all Wave containers [2b8117e9] +- Deprecate module addParams() and params() (#5200) [ci fast] [82c97f8c] +- Remove capsule launcher dependencies (#3395) [f15e4246] +- Fix AWS Cloudwatch access when using custom log group name [30195838] +- Fix Invalid AWS Fargate CPUs usage error reporting [d9c50e59] +- Fix Prevent AwS Batch retry the job execution when the container does not exist [4e218f22] +- Fix Prevent negative cpus values [af2e4ef7] +- Fix ProcessUnrecoverableException detection [17ec6c96] +- Fix aws logs group name (#5146) [643b16b0] +- Fix `readAllBytes` with http files (#5202) [7e90ce62] +- Improve Google Batch 5000x error class handling (#5141) [61b2205f] +- Improve docs [7703f0d0] +- Improve error message for topic channel feature flag (#5161) [c4d407fb] +- Improve fusion docs (#5166) [abdd78f1] +- Improve queue docs (#5154) [bc2fb409] +- Improve version checking [e7a879de] +- Link to other docs on the failOnIgnore option (#5122) [572f2116] +- Make Google Batch auto retry codes configurable (#5148) [e562ce06] +- More robust parsing of shm-size containerOptions (#5177) [b56802a3] +- Prevent default output/error logs for job arrays (#5152) [71f6ed0b] +- Bump amazon sdk to version 1.12.766 [cc6ec314] +- Bump gradle 8.9 [a437e97f] +- Bump jgit 6.10.0 [177dc474] +- Bump nf-amazon@2.7.0 [46c69d77] +- Bump nf-azure@1.8.1 [26dcb604] +- Bump nf-cloudchare@0.4.2 [c171b601] +- Bump nf-codecommit@0.2.2 [d7dd4611] +- Bump nf-console@1.1.4 [c1175157] +- Bump nf-google@1.14.0 [1eda221a] +- Bump nf-tower@1.9.2 [257bebfd] +- Bump nf-wave@1.5.0 [e8d643c2] +- Bump pf4j to version 3.12.0 [96117b9a] +- Bump wave-api to 0.11.1 [96ec4ded] + +### Breaking changes +* [Grape](https://docs.groovy-lang.org/latest/html/documentation/grape.html) dependencies management via `@Grab` annotation is not supported anymore. Custom code requiring third parties libraries should be migrated to a custom plugin diff --git a/changelog/nextflow/v24.08.0-edge.mdx b/changelog/nextflow/v24.08.0-edge.mdx new file mode 100644 index 000000000..ed354e506 --- /dev/null +++ b/changelog/nextflow/v24.08.0-edge.mdx @@ -0,0 +1,24 @@ +--- +title: Nextflow v24.08.0-edge +date: 2024-09-04 +tags: [nextflow] +--- + +- Add Google Batch warning when for conflicting disk image config (#5279) [96cb57cb] +- Add support for Google Batch used specified boot images (#5268) [0aaa6482] +- Disable AWS spot retry (#5215) [f28fcb25] +- Disable Google Batch automatic spot retries (#5223) [aad21533] +- Disable automatic detection of virtual threads (#5270) [b3ba2c2d] +- Fix missing .command.env when eval is used and task runs on a cloud env [4a6b54aa] +- Fix job array syntax for PBS/Torque executor (#5281) [d59f5fae] +- Fix k8s client status cond is possible null in podState (#5264) [46672415] +- Fix non-determinist behaviour of join operator with bag array as key (#5189) [e7dc0d69] +- Fix stage retry on corrupted HTTP downloads (#5275) [bf0cd326] +- Support Azure Managed Identities in Fusion configuration logic (#5278) [a0bf8b40] +- Use public.cr.seqera.io in place of AWS ECR [5a01f277] +- Wave client logs improvement [5a37e617] +- Bump amazoncorretto:21-al2023 [59aed581] +- Bump nf-wave@1.5.1 [97c4e08f] +- Bump nf-google@1.15.0 [24133f2a] +- Bump nf-azure@1.9.0 [29f49ba7] +- Bump nf-amazon@2.8.0 [bbc3adca] diff --git a/changelog/wave/v0.10.0.mdx b/changelog/wave/v0.10.0.mdx new file mode 100644 index 000000000..ba540b397 --- /dev/null +++ b/changelog/wave/v0.10.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.10.0 +date: 2022-08-06T13:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Use WAVE_ENDPOINT variable as server URL by @jordeu in https://github.com/seqeralabs/wave/pull/75 +- Feature: allow mysql or h2 via env configuration by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/77 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.9.1...v0.10.0 diff --git a/changelog/wave/v0.10.1.mdx b/changelog/wave/v0.10.1.mdx new file mode 100644 index 000000000..c422a14a6 --- /dev/null +++ b/changelog/wave/v0.10.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.10.1 +date: 2022-08-06T14:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.10.0...v0.10.1 diff --git a/changelog/wave/v0.10.2.mdx b/changelog/wave/v0.10.2.mdx new file mode 100644 index 000000000..15a215f45 --- /dev/null +++ b/changelog/wave/v0.10.2.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.10.2 +date: 2022-08-06T15:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Increase token expire time by @jordeu in https://github.com/seqeralabs/wave/pull/80 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.10.1...v0.10.2 diff --git a/changelog/wave/v0.10.3.mdx b/changelog/wave/v0.10.3.mdx new file mode 100644 index 000000000..274523694 --- /dev/null +++ b/changelog/wave/v0.10.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.10.3 +date: 2022-08-06T16:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.10.2...v0.10.3 diff --git a/changelog/wave/v0.11.0.mdx b/changelog/wave/v0.11.0.mdx new file mode 100644 index 000000000..4d535a2ec --- /dev/null +++ b/changelog/wave/v0.11.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v0.11.0 +date: 2022-08-06T17:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add config setting for storage cache [e6d3d33d] +- Improve unit tests for manifest and blob cache [70ba6886] +- Improve config [9b8e3d46] +- Add support for mail notification [7e862bc8] +- Update wave.build.repo config [d3e5ca61] +- Add support for AWS params store [29e2a89b] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.10.3...v0.11.0 diff --git a/changelog/wave/v0.11.1.mdx b/changelog/wave/v0.11.1.mdx new file mode 100644 index 000000000..09c570a64 --- /dev/null +++ b/changelog/wave/v0.11.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.11.1 +date: 2022-08-09T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.11.0...v0.11.1 diff --git a/changelog/wave/v0.11.2.mdx b/changelog/wave/v0.11.2.mdx new file mode 100644 index 000000000..889431dd2 --- /dev/null +++ b/changelog/wave/v0.11.2.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.11.2 +date: 2022-08-11T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Generate build-info as an externalized resources by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/85 +- AWS EC2 profile by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/83 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.11.1...v0.11.2 diff --git a/changelog/wave/v0.11.3.mdx b/changelog/wave/v0.11.3.mdx new file mode 100644 index 000000000..d4bd767e2 --- /dev/null +++ b/changelog/wave/v0.11.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.11.3 +date: 2022-08-11 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.11.2...v0.11.3 diff --git a/changelog/wave/v0.11.4.mdx b/changelog/wave/v0.11.4.mdx new file mode 100644 index 000000000..2f842fc30 --- /dev/null +++ b/changelog/wave/v0.11.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.11.4 +date: 2022-08-12 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.11.3...v0.11.4 diff --git a/changelog/wave/v0.12.0.mdx b/changelog/wave/v0.12.0.mdx new file mode 100644 index 000000000..71bc7f6a6 --- /dev/null +++ b/changelog/wave/v0.12.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.12.0 +date: 2022-08-16T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Improve error handling by @pditommaso in https://github.com/seqeralabs/wave/pull/95 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.11.4...v0.12.0 diff --git a/changelog/wave/v0.12.1.mdx b/changelog/wave/v0.12.1.mdx new file mode 100644 index 000000000..c194f27ec --- /dev/null +++ b/changelog/wave/v0.12.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.12.1 +date: 2022-08-16T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.12.0...v0.12.1 diff --git a/changelog/wave/v0.13.0.mdx b/changelog/wave/v0.13.0.mdx new file mode 100644 index 000000000..f962b2db0 --- /dev/null +++ b/changelog/wave/v0.13.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.13.0 +date: 2022-08-17 +tags: [wave] +--- + +## Feature updates and improvements + +- Use CompletableFuture instead Future to listen progress in the task by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/98 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.12.1...v0.13.0 diff --git a/changelog/wave/v0.13.1.mdx b/changelog/wave/v0.13.1.mdx new file mode 100644 index 000000000..e9a766dbe --- /dev/null +++ b/changelog/wave/v0.13.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.13.1 +date: 2022-08-23 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.13.0...v0.13.1 diff --git a/changelog/wave/v0.14.0.mdx b/changelog/wave/v0.14.0.mdx new file mode 100644 index 000000000..890b8a265 --- /dev/null +++ b/changelog/wave/v0.14.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.14.0 +date: 2022-09-03 +tags: [wave] +--- + +## Feature updates and improvements + +- Bugfix: init-container optional if no creds provided by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/103 +- Remove build pack artifacts by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/101 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.13.1...v0.14.0 diff --git a/changelog/wave/v0.14.1.mdx b/changelog/wave/v0.14.1.mdx new file mode 100644 index 000000000..a94116b09 --- /dev/null +++ b/changelog/wave/v0.14.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.14.1 +date: 2022-09-05 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.14.0...v0.14.1 diff --git a/changelog/wave/v0.14.2.mdx b/changelog/wave/v0.14.2.mdx new file mode 100644 index 000000000..33d4c8b84 --- /dev/null +++ b/changelog/wave/v0.14.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.14.2 +date: 2022-09-07 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.14.1...v0.14.2 diff --git a/changelog/wave/v0.15.0.mdx b/changelog/wave/v0.15.0.mdx new file mode 100644 index 000000000..8429719b5 --- /dev/null +++ b/changelog/wave/v0.15.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v0.15.0 +date: 2022-09-10 +tags: [wave] +--- + +## Feature updates and improvements + +- Feature: specify customs labels for build pod by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/117 +- Feature: specify node-selector and service-account (#118) by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/119 +- Feature: rate limit for builds by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/114 +- Bugfix: activate storage factory in rate-limit by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/121 +- Feature: refactor token generation (#115) by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/122 +- Feature: add rate limiter for docker request by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/120 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.14.2...v0.15.0 diff --git a/changelog/wave/v0.15.1.mdx b/changelog/wave/v0.15.1.mdx new file mode 100644 index 000000000..40b0357de --- /dev/null +++ b/changelog/wave/v0.15.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.15.1 +date: 2022-09-11 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.15.0...v0.15.1 diff --git a/changelog/wave/v0.15.2.mdx b/changelog/wave/v0.15.2.mdx new file mode 100644 index 000000000..7dc05eaa0 --- /dev/null +++ b/changelog/wave/v0.15.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.15.2 +date: 2022-09-12 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.15.1...v0.15.2 diff --git a/changelog/wave/v0.16.0.mdx b/changelog/wave/v0.16.0.mdx new file mode 100644 index 000000000..e0e69e19c --- /dev/null +++ b/changelog/wave/v0.16.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.16.0 +date: 2022-09-14 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.15.2...v0.16.0 diff --git a/changelog/wave/v0.17.0.mdx b/changelog/wave/v0.17.0.mdx new file mode 100644 index 000000000..187457115 --- /dev/null +++ b/changelog/wave/v0.17.0.mdx @@ -0,0 +1,17 @@ +--- +title: Wave v0.17.0 +date: 2022-09-16 +tags: [wave] +--- + +## Feature updates and improvements + +- Update README.md by @llewellyn-sl in https://github.com/seqeralabs/wave/pull/130 +- Refactor: different rate limit for auths or anonymous requests by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/131 +- Build cache storage by @pditommaso in https://github.com/seqeralabs/wave/pull/129 + +## New Contributors + +- @llewellyn-sl made their first contribution in https://github.com/seqeralabs/wave/pull/130 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.16.0...v0.17.0 diff --git a/changelog/wave/v0.17.1.mdx b/changelog/wave/v0.17.1.mdx new file mode 100644 index 000000000..03da4a3e8 --- /dev/null +++ b/changelog/wave/v0.17.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.17.1 +date: 2022-09-17 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.17.0...v0.17.1 diff --git a/changelog/wave/v0.18.0.mdx b/changelog/wave/v0.18.0.mdx new file mode 100644 index 000000000..80f2b0ed0 --- /dev/null +++ b/changelog/wave/v0.18.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.18.0 +date: 2022-09-18 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.17.1...v0.18.0 diff --git a/changelog/wave/v0.18.1.mdx b/changelog/wave/v0.18.1.mdx new file mode 100644 index 000000000..43b94310d --- /dev/null +++ b/changelog/wave/v0.18.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.18.1 +date: 2022-09-19 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.18.0...v0.18.1 diff --git a/changelog/wave/v0.19.0.mdx b/changelog/wave/v0.19.0.mdx new file mode 100644 index 000000000..b33336973 --- /dev/null +++ b/changelog/wave/v0.19.0.mdx @@ -0,0 +1,14 @@ +--- +title: Wave v0.19.0 +date: 2022-09-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Return a clear error message when rate limit is hit by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/138 +- Prefix objects store in redis by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/141 +- Improve ratelimit test by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/142 +- Render build timeout exception using docker format by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/143 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.18.1...v0.19.0 diff --git a/changelog/wave/v0.19.1.mdx b/changelog/wave/v0.19.1.mdx new file mode 100644 index 000000000..e80a60d66 --- /dev/null +++ b/changelog/wave/v0.19.1.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v0.19.1 +date: 2022-09-23T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Notask: adds monitoring endpoint for prometheus by @swampie in https://github.com/seqeralabs/wave/pull/147 + +## New Contributors + +- @swampie made their first contribution in https://github.com/seqeralabs/wave/pull/147 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.19.0...v0.19.1 diff --git a/changelog/wave/v0.19.2.mdx b/changelog/wave/v0.19.2.mdx new file mode 100644 index 000000000..4c351b206 --- /dev/null +++ b/changelog/wave/v0.19.2.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.19.2 +date: 2022-09-23T11:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add test to build and push to registries by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/148 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.19.1...v0.19.2 diff --git a/changelog/wave/v0.19.3.mdx b/changelog/wave/v0.19.3.mdx new file mode 100644 index 000000000..f25285e75 --- /dev/null +++ b/changelog/wave/v0.19.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.19.3 +date: 2022-09-23T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.19.2...v0.19.3 diff --git a/changelog/wave/v0.19.4.mdx b/changelog/wave/v0.19.4.mdx new file mode 100644 index 000000000..3ce23e6f7 --- /dev/null +++ b/changelog/wave/v0.19.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.19.4 +date: 2022-09-24T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.19.3...v0.19.4 diff --git a/changelog/wave/v0.20.0.mdx b/changelog/wave/v0.20.0.mdx new file mode 100644 index 000000000..0f87d632a --- /dev/null +++ b/changelog/wave/v0.20.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.20.0 +date: 2022-09-24T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.19.4...v0.20.0 diff --git a/changelog/wave/v0.20.1.mdx b/changelog/wave/v0.20.1.mdx new file mode 100644 index 000000000..9a13e7173 --- /dev/null +++ b/changelog/wave/v0.20.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.20.1 +date: 2022-09-25 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.20.0...v0.20.1 diff --git a/changelog/wave/v0.20.2.mdx b/changelog/wave/v0.20.2.mdx new file mode 100644 index 000000000..ad81c0404 --- /dev/null +++ b/changelog/wave/v0.20.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.20.2 +date: 2022-09-26T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.20.1...v0.20.2 diff --git a/changelog/wave/v0.20.3.mdx b/changelog/wave/v0.20.3.mdx new file mode 100644 index 000000000..212a0976f --- /dev/null +++ b/changelog/wave/v0.20.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.20.3 +date: 2022-09-26T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.20.2...v0.20.3 diff --git a/changelog/wave/v0.21.0.mdx b/changelog/wave/v0.21.0.mdx new file mode 100644 index 000000000..485ccc942 --- /dev/null +++ b/changelog/wave/v0.21.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.21.0 +date: 2022-09-27T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add support for google artifact registry by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/157 +- Fix: Disable discovery client caching and re enable prometheus config by @swampie in https://github.com/seqeralabs/wave/pull/156 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.20.3...v0.21.0 diff --git a/changelog/wave/v0.21.1.mdx b/changelog/wave/v0.21.1.mdx new file mode 100644 index 000000000..71d79611a --- /dev/null +++ b/changelog/wave/v0.21.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.21.1 +date: 2022-09-27T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.0...v0.21.1 diff --git a/changelog/wave/v0.21.2.mdx b/changelog/wave/v0.21.2.mdx new file mode 100644 index 000000000..0f1c083e9 --- /dev/null +++ b/changelog/wave/v0.21.2.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.21.2 +date: 2022-09-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Add test for user info by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/161 +- Add new get direct response in proxyclient by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/162 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.1...v0.21.2 diff --git a/changelog/wave/v0.21.3.mdx b/changelog/wave/v0.21.3.mdx new file mode 100644 index 000000000..016966202 --- /dev/null +++ b/changelog/wave/v0.21.3.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.21.3 +date: 2022-10-01 +tags: [wave] +--- + +## Feature updates and improvements + +- Parse token body only when status code is 200 by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/164 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.2...v0.21.3 diff --git a/changelog/wave/v0.21.4.mdx b/changelog/wave/v0.21.4.mdx new file mode 100644 index 000000000..bcf188074 --- /dev/null +++ b/changelog/wave/v0.21.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.21.4 +date: 2022-10-03 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.3...v0.21.4 diff --git a/changelog/wave/v0.21.5.mdx b/changelog/wave/v0.21.5.mdx new file mode 100644 index 000000000..c51f7aa2f --- /dev/null +++ b/changelog/wave/v0.21.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.21.5 +date: 2022-10-04 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.4...v0.21.5 diff --git a/changelog/wave/v0.21.6.mdx b/changelog/wave/v0.21.6.mdx new file mode 100644 index 000000000..8bad94606 --- /dev/null +++ b/changelog/wave/v0.21.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.21.6 +date: 2022-10-17 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.5...v0.21.6 diff --git a/changelog/wave/v0.21.7.mdx b/changelog/wave/v0.21.7.mdx new file mode 100644 index 000000000..dc837a213 --- /dev/null +++ b/changelog/wave/v0.21.7.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.21.7 +date: 2022-10-18 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.6...v0.21.7 diff --git a/changelog/wave/v0.22.0.mdx b/changelog/wave/v0.22.0.mdx new file mode 100644 index 000000000..66e13a8ea --- /dev/null +++ b/changelog/wave/v0.22.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v0.22.0 +date: 2022-10-23T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Make tower user auth async by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/166 +- Improve the time format in the completion email by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/169 +- Upgrade to micronaut 3.7.2 by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/174 +- Check if target image exist before building a new one by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/173 +- Kaniko 1.9.1 by @pditommaso in https://github.com/seqeralabs/wave/pull/175 +- Improve build cache for failed builds by @pditommaso in https://github.com/seqeralabs/wave/pull/176 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.21.7...v0.22.0 diff --git a/changelog/wave/v0.22.1.mdx b/changelog/wave/v0.22.1.mdx new file mode 100644 index 000000000..2024b6c68 --- /dev/null +++ b/changelog/wave/v0.22.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.22.1 +date: 2022-10-23T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.22.0...v0.22.1 diff --git a/changelog/wave/v0.22.2.mdx b/changelog/wave/v0.22.2.mdx new file mode 100644 index 000000000..3c3db716c --- /dev/null +++ b/changelog/wave/v0.22.2.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.22.2 +date: 2022-10-24 +tags: [wave] +--- + +## Feature updates and improvements + +- Enable redis pool configuration by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/179 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.22.1...v0.22.2 diff --git a/changelog/wave/v0.22.3.mdx b/changelog/wave/v0.22.3.mdx new file mode 100644 index 000000000..3cc091417 --- /dev/null +++ b/changelog/wave/v0.22.3.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.22.3 +date: 2022-10-26T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Remove the use of the init container by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/180 +- Wait for redis testcontainer is ready by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/181 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.22.2...v0.22.3 diff --git a/changelog/wave/v0.22.4.mdx b/changelog/wave/v0.22.4.mdx new file mode 100644 index 000000000..2dd86ca3c --- /dev/null +++ b/changelog/wave/v0.22.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.22.4 +date: 2022-10-26T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.22.3...v0.22.4 diff --git a/changelog/wave/v0.23.0.mdx b/changelog/wave/v0.23.0.mdx new file mode 100644 index 000000000..a28bf4c52 --- /dev/null +++ b/changelog/wave/v0.23.0.mdx @@ -0,0 +1,21 @@ +--- +title: Wave v0.23.0 +date: 2022-11-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Stop redis in every test by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/184 +- First implementation of stats service by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/163 +- Bump view first iteration by @pditommaso in https://github.com/seqeralabs/wave/pull/187 +- Use jedis instead jedispool in tests by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/188 +- Multi platform build by @pditommaso in https://github.com/seqeralabs/wave/pull/125 +- Add cacheable + retryable for isManifestPresent by @pditommaso in https://github.com/seqeralabs/wave/pull/191 +- Remove fixed registry configurations by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/192 +- Upgrade github actions to v3 by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/196 +- Improve visualization for builds by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/197 +- Add skaffold configuration for local development by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/194 +- Add support for singularity container engine by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/202 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.22.4...v0.23.0 diff --git a/changelog/wave/v0.23.1.mdx b/changelog/wave/v0.23.1.mdx new file mode 100644 index 000000000..8f7a2fbd6 --- /dev/null +++ b/changelog/wave/v0.23.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.1 +date: 2022-11-26 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.0...v0.23.1 diff --git a/changelog/wave/v0.23.2.mdx b/changelog/wave/v0.23.2.mdx new file mode 100644 index 000000000..1ff83bc21 --- /dev/null +++ b/changelog/wave/v0.23.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.2 +date: 2022-12-03 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.1...v0.23.2 diff --git a/changelog/wave/v0.23.3.mdx b/changelog/wave/v0.23.3.mdx new file mode 100644 index 000000000..58d6a14eb --- /dev/null +++ b/changelog/wave/v0.23.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.3 +date: 2022-12-03 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.2...v0.23.3 diff --git a/changelog/wave/v0.23.4.mdx b/changelog/wave/v0.23.4.mdx new file mode 100644 index 000000000..9c08e6490 --- /dev/null +++ b/changelog/wave/v0.23.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.4 +date: 2022-12-08 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.3...v0.23.4 diff --git a/changelog/wave/v0.23.5.mdx b/changelog/wave/v0.23.5.mdx new file mode 100644 index 000000000..4063182ae --- /dev/null +++ b/changelog/wave/v0.23.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.5 +date: 2022-12-09 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.4...v0.23.5 diff --git a/changelog/wave/v0.23.6.mdx b/changelog/wave/v0.23.6.mdx new file mode 100644 index 000000000..b3b688d6d --- /dev/null +++ b/changelog/wave/v0.23.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.6 +date: 2022-12-21 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.5...v0.23.6 diff --git a/changelog/wave/v0.23.7.mdx b/changelog/wave/v0.23.7.mdx new file mode 100644 index 000000000..425b2eaa8 --- /dev/null +++ b/changelog/wave/v0.23.7.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.23.7 +date: 2022-12-23 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.6...v0.23.7 diff --git a/changelog/wave/v0.24.0.mdx b/changelog/wave/v0.24.0.mdx new file mode 100644 index 000000000..25c19a3df --- /dev/null +++ b/changelog/wave/v0.24.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.24.0 +date: 2023-01-17T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Security service for safe credentials exchance by @pditommaso in https://github.com/seqeralabs/wave/pull/207 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.23.7...v0.24.0 diff --git a/changelog/wave/v0.24.1.mdx b/changelog/wave/v0.24.1.mdx new file mode 100644 index 000000000..f430a660f --- /dev/null +++ b/changelog/wave/v0.24.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.24.1 +date: 2023-01-17T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.0...v0.24.1 diff --git a/changelog/wave/v0.24.2.mdx b/changelog/wave/v0.24.2.mdx new file mode 100644 index 000000000..e26b67c12 --- /dev/null +++ b/changelog/wave/v0.24.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.24.2 +date: 2023-01-18 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.1...v0.24.2 diff --git a/changelog/wave/v0.24.3.mdx b/changelog/wave/v0.24.3.mdx new file mode 100644 index 000000000..5f95dc240 --- /dev/null +++ b/changelog/wave/v0.24.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.24.3 +date: 2023-01-19 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.2...v0.24.3 diff --git a/changelog/wave/v0.24.4.mdx b/changelog/wave/v0.24.4.mdx new file mode 100644 index 000000000..461b078bf --- /dev/null +++ b/changelog/wave/v0.24.4.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v0.24.4 +date: 2023-01-23T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Task 212 213/improve tower client by @t0randr in https://github.com/seqeralabs/wave/pull/215 + +## New Contributors + +- @t0randr made their first contribution in https://github.com/seqeralabs/wave/pull/215 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.3...v0.24.4 diff --git a/changelog/wave/v0.24.5.mdx b/changelog/wave/v0.24.5.mdx new file mode 100644 index 000000000..8658d4dc6 --- /dev/null +++ b/changelog/wave/v0.24.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.24.5 +date: 2023-01-25T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.4...v0.24.5 diff --git a/changelog/wave/v0.25.0.mdx b/changelog/wave/v0.25.0.mdx new file mode 100644 index 000000000..44a71ba74 --- /dev/null +++ b/changelog/wave/v0.25.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.25.0 +date: 2023-02-05T12:00 +tags: [wave] +--- + +## Feature updates and improvements + +- IoException handling by @t0randr in https://github.com/seqeralabs/wave/pull/219 +- Wave container requests store and introspection by @pditommaso in https://github.com/seqeralabs/wave/pull/217 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.24.5...v0.25.0 diff --git a/changelog/wave/v0.25.1.mdx b/changelog/wave/v0.25.1.mdx new file mode 100644 index 000000000..c57d3790b --- /dev/null +++ b/changelog/wave/v0.25.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.25.1 +date: 2023-02-07 +tags: [wave] +--- + +## Feature updates and improvements + +- Task 216/pairing keys lease by @t0randr in https://github.com/seqeralabs/wave/pull/218 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.0...v0.25.1 diff --git a/changelog/wave/v0.25.10.mdx b/changelog/wave/v0.25.10.mdx new file mode 100644 index 000000000..29a0bffb7 --- /dev/null +++ b/changelog/wave/v0.25.10.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.10 +date: 2023-02-24 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.9...v0.25.10 diff --git a/changelog/wave/v0.25.2.mdx b/changelog/wave/v0.25.2.mdx new file mode 100644 index 000000000..da460df71 --- /dev/null +++ b/changelog/wave/v0.25.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.2 +date: 2023-02-10 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.1...v0.25.2 diff --git a/changelog/wave/v0.25.3.mdx b/changelog/wave/v0.25.3.mdx new file mode 100644 index 000000000..78de63cc8 --- /dev/null +++ b/changelog/wave/v0.25.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.3 +date: 2023-02-11T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.2...v0.25.3 diff --git a/changelog/wave/v0.25.4.mdx b/changelog/wave/v0.25.4.mdx new file mode 100644 index 000000000..dd85b7665 --- /dev/null +++ b/changelog/wave/v0.25.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.4 +date: 2023-02-11T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.3...v0.25.4 diff --git a/changelog/wave/v0.25.5.mdx b/changelog/wave/v0.25.5.mdx new file mode 100644 index 000000000..b669b16e6 --- /dev/null +++ b/changelog/wave/v0.25.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.5 +date: 2023-02-11T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.4...v0.25.5 diff --git a/changelog/wave/v0.25.6.mdx b/changelog/wave/v0.25.6.mdx new file mode 100644 index 000000000..653dc9419 --- /dev/null +++ b/changelog/wave/v0.25.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.6 +date: 2023-02-15 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.5...v0.25.6 diff --git a/changelog/wave/v0.25.7.mdx b/changelog/wave/v0.25.7.mdx new file mode 100644 index 000000000..368c1116a --- /dev/null +++ b/changelog/wave/v0.25.7.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.7 +date: 2023-02-21T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.6...v0.25.7 diff --git a/changelog/wave/v0.25.8.mdx b/changelog/wave/v0.25.8.mdx new file mode 100644 index 000000000..8d318ac2c --- /dev/null +++ b/changelog/wave/v0.25.8.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.25.8 +date: 2023-02-21T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.7...v0.25.8 diff --git a/changelog/wave/v0.25.9.mdx b/changelog/wave/v0.25.9.mdx new file mode 100644 index 000000000..60a10fb51 --- /dev/null +++ b/changelog/wave/v0.25.9.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.25.9 +date: 2023-02-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix pairing record lease by @pditommaso in https://github.com/seqeralabs/wave/pull/222 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.8...v0.25.9 diff --git a/changelog/wave/v0.26.0.mdx b/changelog/wave/v0.26.0.mdx new file mode 100644 index 000000000..e5cc2dd02 --- /dev/null +++ b/changelog/wave/v0.26.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.0 +date: 2023-02-26 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.25.10...v0.26.0 diff --git a/changelog/wave/v0.26.1.mdx b/changelog/wave/v0.26.1.mdx new file mode 100644 index 000000000..789dcf9c1 --- /dev/null +++ b/changelog/wave/v0.26.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.1 +date: 2023-03-01 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.0...v0.26.1 diff --git a/changelog/wave/v0.26.2.mdx b/changelog/wave/v0.26.2.mdx new file mode 100644 index 000000000..9cfc5b644 --- /dev/null +++ b/changelog/wave/v0.26.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.2 +date: 2023-03-03 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.1...v0.26.2 diff --git a/changelog/wave/v0.26.3.mdx b/changelog/wave/v0.26.3.mdx new file mode 100644 index 000000000..b1936d18e --- /dev/null +++ b/changelog/wave/v0.26.3.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.26.3 +date: 2023-03-15 +tags: [wave] +--- + +## Feature updates and improvements + +- Add Mkdocs documentation by @pditommaso in https://github.com/seqeralabs/wave/pull/221 +- Remove GitHub repo from header, as private by @ewels in https://github.com/seqeralabs/wave/pull/234 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.2...v0.26.3 diff --git a/changelog/wave/v0.26.4.mdx b/changelog/wave/v0.26.4.mdx new file mode 100644 index 000000000..948f940e7 --- /dev/null +++ b/changelog/wave/v0.26.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.4 +date: 2023-03-17T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.3...v0.26.4 diff --git a/changelog/wave/v0.26.5.mdx b/changelog/wave/v0.26.5.mdx new file mode 100644 index 000000000..c620879ec --- /dev/null +++ b/changelog/wave/v0.26.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.5 +date: 2023-03-17T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.4...v0.26.5 diff --git a/changelog/wave/v0.26.6.mdx b/changelog/wave/v0.26.6.mdx new file mode 100644 index 000000000..8c86ea097 --- /dev/null +++ b/changelog/wave/v0.26.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.6 +date: 2023-03-21 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.5...v0.26.6 diff --git a/changelog/wave/v0.26.7.mdx b/changelog/wave/v0.26.7.mdx new file mode 100644 index 000000000..5f7dfaca9 --- /dev/null +++ b/changelog/wave/v0.26.7.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.7 +date: 2023-03-22 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.6...v0.26.7 diff --git a/changelog/wave/v0.26.8.mdx b/changelog/wave/v0.26.8.mdx new file mode 100644 index 000000000..2123fe56c --- /dev/null +++ b/changelog/wave/v0.26.8.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.26.8 +date: 2023-03-25 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.7...v0.26.8 diff --git a/changelog/wave/v0.27.0.mdx b/changelog/wave/v0.27.0.mdx new file mode 100644 index 000000000..ceba89fac --- /dev/null +++ b/changelog/wave/v0.27.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.27.0 +date: 2023-03-27 +tags: [wave] +--- + +## Feature updates and improvements + +- Wave pairing simple by @pditommaso in https://github.com/seqeralabs/wave/pull/237 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.26.8...v0.27.0 diff --git a/changelog/wave/v0.27.1.mdx b/changelog/wave/v0.27.1.mdx new file mode 100644 index 000000000..cb3db1429 --- /dev/null +++ b/changelog/wave/v0.27.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.27.1 +date: 2023-03-30 +tags: [wave] +--- + +## Feature updates and improvements + +- Websocket pairing using Redis streams by @jordeu in https://github.com/seqeralabs/wave/pull/238 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.27.0...v0.27.1 diff --git a/changelog/wave/v0.27.2.mdx b/changelog/wave/v0.27.2.mdx new file mode 100644 index 000000000..2192be88c --- /dev/null +++ b/changelog/wave/v0.27.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.27.2 +date: 2023-04-01 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.27.1...v0.27.2 diff --git a/changelog/wave/v0.28.0.mdx b/changelog/wave/v0.28.0.mdx new file mode 100644 index 000000000..2c5132792 --- /dev/null +++ b/changelog/wave/v0.28.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.28.0 +date: 2023-04-03 +tags: [wave] +--- + +## Feature updates and improvements + +- Pairing queue by @pditommaso in https://github.com/seqeralabs/wave/pull/241 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.27.2...v0.28.0 diff --git a/changelog/wave/v0.28.1.mdx b/changelog/wave/v0.28.1.mdx new file mode 100644 index 000000000..e9db03b1c --- /dev/null +++ b/changelog/wave/v0.28.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.28.1 +date: 2023-04-04T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add workflows for deployment previews on Vercel by @ewels in https://github.com/seqeralabs/wave/pull/243 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.0...v0.28.1 diff --git a/changelog/wave/v0.28.2.mdx b/changelog/wave/v0.28.2.mdx new file mode 100644 index 000000000..39fd1a477 --- /dev/null +++ b/changelog/wave/v0.28.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.28.2 +date: 2023-04-04T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.1...v0.28.2 diff --git a/changelog/wave/v0.28.3.mdx b/changelog/wave/v0.28.3.mdx new file mode 100644 index 000000000..831414dd1 --- /dev/null +++ b/changelog/wave/v0.28.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.28.3 +date: 2023-04-04T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.2...v0.28.3 diff --git a/changelog/wave/v0.28.4.mdx b/changelog/wave/v0.28.4.mdx new file mode 100644 index 000000000..21b877c83 --- /dev/null +++ b/changelog/wave/v0.28.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.28.4 +date: 2023-04-04T13:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.3...v0.28.4 diff --git a/changelog/wave/v0.28.5.mdx b/changelog/wave/v0.28.5.mdx new file mode 100644 index 000000000..e6b382bd2 --- /dev/null +++ b/changelog/wave/v0.28.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.28.5 +date: 2023-04-04T14:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.4...v0.28.5 diff --git a/changelog/wave/v0.28.6.mdx b/changelog/wave/v0.28.6.mdx new file mode 100644 index 000000000..5980cb746 --- /dev/null +++ b/changelog/wave/v0.28.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.28.6 +date: 2023-04-05T15:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.5...v0.28.6 diff --git a/changelog/wave/v0.29.0.mdx b/changelog/wave/v0.29.0.mdx new file mode 100644 index 000000000..1a26254c1 --- /dev/null +++ b/changelog/wave/v0.29.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.0 +date: 2023-04-05T16:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.28.6...v0.29.0 diff --git a/changelog/wave/v0.29.1.mdx b/changelog/wave/v0.29.1.mdx new file mode 100644 index 000000000..54a667efe --- /dev/null +++ b/changelog/wave/v0.29.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.1 +date: 2023-04-05T17:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.0...v0.29.1 diff --git a/changelog/wave/v0.29.2.mdx b/changelog/wave/v0.29.2.mdx new file mode 100644 index 000000000..42039f1b0 --- /dev/null +++ b/changelog/wave/v0.29.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.2 +date: 2023-04-05T18:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.1...v0.29.2 diff --git a/changelog/wave/v0.29.3.mdx b/changelog/wave/v0.29.3.mdx new file mode 100644 index 000000000..0d02d8a5e --- /dev/null +++ b/changelog/wave/v0.29.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.3 +date: 2023-04-05T19:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.2...v0.29.3 diff --git a/changelog/wave/v0.29.4.mdx b/changelog/wave/v0.29.4.mdx new file mode 100644 index 000000000..fdca70849 --- /dev/null +++ b/changelog/wave/v0.29.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.4 +date: 2023-04-05T20:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.3...v0.29.4 diff --git a/changelog/wave/v0.29.5.mdx b/changelog/wave/v0.29.5.mdx new file mode 100644 index 000000000..c2c454a31 --- /dev/null +++ b/changelog/wave/v0.29.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.5 +date: 2023-04-06T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.4...v0.29.5 diff --git a/changelog/wave/v0.29.6.mdx b/changelog/wave/v0.29.6.mdx new file mode 100644 index 000000000..6f0bfe5d7 --- /dev/null +++ b/changelog/wave/v0.29.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.29.6 +date: 2023-04-06T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.5...v0.29.6 diff --git a/changelog/wave/v0.30.0.mdx b/changelog/wave/v0.30.0.mdx new file mode 100644 index 000000000..33e1ec099 --- /dev/null +++ b/changelog/wave/v0.30.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.30.0 +date: 2023-04-07 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.29.6...v0.30.0 diff --git a/changelog/wave/v0.30.1.mdx b/changelog/wave/v0.30.1.mdx new file mode 100644 index 000000000..2825b5e91 --- /dev/null +++ b/changelog/wave/v0.30.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.30.1 +date: 2023-04-08 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.30.0...v0.30.1 diff --git a/changelog/wave/v0.30.2.mdx b/changelog/wave/v0.30.2.mdx new file mode 100644 index 000000000..ec58e890c --- /dev/null +++ b/changelog/wave/v0.30.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.30.2 +date: 2023-04-25 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.30.1...v0.30.2 diff --git a/changelog/wave/v0.30.3.mdx b/changelog/wave/v0.30.3.mdx new file mode 100644 index 000000000..220a87584 --- /dev/null +++ b/changelog/wave/v0.30.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.30.3 +date: 2023-04-26 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.30.1...v0.30.3 diff --git a/changelog/wave/v0.31.0.mdx b/changelog/wave/v0.31.0.mdx new file mode 100644 index 000000000..9359e877d --- /dev/null +++ b/changelog/wave/v0.31.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.31.0 +date: 2023-04-29 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.30.3...v0.31.0 diff --git a/changelog/wave/v0.31.1.mdx b/changelog/wave/v0.31.1.mdx new file mode 100644 index 000000000..744178767 --- /dev/null +++ b/changelog/wave/v0.31.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.31.1 +date: 2023-05-03 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.31.0...v0.31.1 diff --git a/changelog/wave/v0.32.0.mdx b/changelog/wave/v0.32.0.mdx new file mode 100644 index 000000000..006530bb9 --- /dev/null +++ b/changelog/wave/v0.32.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.32.0 +date: 2023-05-07T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.31.1...v0.32.0 diff --git a/changelog/wave/v0.32.1.mdx b/changelog/wave/v0.32.1.mdx new file mode 100644 index 000000000..656479832 --- /dev/null +++ b/changelog/wave/v0.32.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.32.1 +date: 2023-05-07T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.32.0...v0.32.1 diff --git a/changelog/wave/v0.32.2.mdx b/changelog/wave/v0.32.2.mdx new file mode 100644 index 000000000..3303351bd --- /dev/null +++ b/changelog/wave/v0.32.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.32.2 +date: 2023-05-13 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.32.1...v0.32.2 diff --git a/changelog/wave/v0.33.0.mdx b/changelog/wave/v0.33.0.mdx new file mode 100644 index 000000000..70428ac04 --- /dev/null +++ b/changelog/wave/v0.33.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.33.0 +date: 2023-05-16 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.32.2...v0.33.0 diff --git a/changelog/wave/v0.33.1.mdx b/changelog/wave/v0.33.1.mdx new file mode 100644 index 000000000..ba2384e66 --- /dev/null +++ b/changelog/wave/v0.33.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.33.1 +date: 2023-05-21 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.33.0...v0.33.1 diff --git a/changelog/wave/v0.33.2.mdx b/changelog/wave/v0.33.2.mdx new file mode 100644 index 000000000..d8fea3dba --- /dev/null +++ b/changelog/wave/v0.33.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.33.2 +date: 2023-05-30T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.33.1...v0.33.2 diff --git a/changelog/wave/v0.33.3.mdx b/changelog/wave/v0.33.3.mdx new file mode 100644 index 000000000..f11873da1 --- /dev/null +++ b/changelog/wave/v0.33.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.33.3 +date: 2023-05-30T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.33.1...v0.33.3 diff --git a/changelog/wave/v0.33.4.mdx b/changelog/wave/v0.33.4.mdx new file mode 100644 index 000000000..d2493e6d2 --- /dev/null +++ b/changelog/wave/v0.33.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.33.4 +date: 2023-06-08 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.33.3...v0.33.4 diff --git a/changelog/wave/v0.34.0.mdx b/changelog/wave/v0.34.0.mdx new file mode 100644 index 000000000..79b4eaef5 --- /dev/null +++ b/changelog/wave/v0.34.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.34.0 +date: 2023-06-15 +tags: [wave] +--- + +## Feature updates and improvements + +- Add support for share dir required by Spack build by @pditommaso in https://github.com/seqeralabs/wave/pull/249 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.33.4...v0.34.0 diff --git a/changelog/wave/v0.34.1.mdx b/changelog/wave/v0.34.1.mdx new file mode 100644 index 000000000..d0e1eacaa --- /dev/null +++ b/changelog/wave/v0.34.1.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v0.34.1 +date: 2023-07-02T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Changes to fix CVEs by @munishchouhan in https://github.com/seqeralabs/wave/pull/250 + +## New Contributors + +- @munishchouhan made their first contribution in https://github.com/seqeralabs/wave/pull/250 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.34.0...v0.34.1 diff --git a/changelog/wave/v0.34.2.mdx b/changelog/wave/v0.34.2.mdx new file mode 100644 index 000000000..3f5105e4f --- /dev/null +++ b/changelog/wave/v0.34.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.34.2 +date: 2023-07-02T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.34.1...v0.34.2 diff --git a/changelog/wave/v0.34.3.mdx b/changelog/wave/v0.34.3.mdx new file mode 100644 index 000000000..36929e454 --- /dev/null +++ b/changelog/wave/v0.34.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.34.3 +date: 2023-07-13 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.34.2...v0.34.3 diff --git a/changelog/wave/v0.35.0.mdx b/changelog/wave/v0.35.0.mdx new file mode 100644 index 000000000..381ebc507 --- /dev/null +++ b/changelog/wave/v0.35.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v0.35.0 +date: 2023-07-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Add ContainerScanService by @munishchouhan in https://github.com/seqeralabs/wave/pull/253 +- Freeze container feature by @pditommaso in https://github.com/seqeralabs/wave/pull/260 +- Ids corrected in logs of scanning by @munishchouhan in https://github.com/seqeralabs/wave/pull/263 +- Added AWS SES Support in mail service by @munishchouhan in https://github.com/seqeralabs/wave/pull/267 +- Fixed "Fail parsing the Trivy result should not cause the Wave request to fail" by @munishchouhan in https://github.com/seqeralabs/wave/pull/270 +- Surreal errors reported in the log by @munishchouhan in https://github.com/seqeralabs/wave/pull/271 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.34.3...v0.35.0 diff --git a/changelog/wave/v0.35.1.mdx b/changelog/wave/v0.35.1.mdx new file mode 100644 index 000000000..8054c0845 --- /dev/null +++ b/changelog/wave/v0.35.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.35.1 +date: 2023-07-24 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.35.0...v0.35.1 diff --git a/changelog/wave/v0.35.2.mdx b/changelog/wave/v0.35.2.mdx new file mode 100644 index 000000000..2eeeb72dd --- /dev/null +++ b/changelog/wave/v0.35.2.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v0.35.2 +date: 2023-08-01 +tags: [wave] +--- + +## Feature updates and improvements + +- Added retry in SurrealClient by @munishchouhan in https://github.com/seqeralabs/wave/pull/276 +- Enable netty metrics by @jimmypoms in https://github.com/seqeralabs/wave/pull/277 + +## New Contributors + +- @jimmypoms made their first contribution in https://github.com/seqeralabs/wave/pull/277 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.35.1...v0.35.2 diff --git a/changelog/wave/v0.35.3.mdx b/changelog/wave/v0.35.3.mdx new file mode 100644 index 000000000..83d4ad1d3 --- /dev/null +++ b/changelog/wave/v0.35.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.35.3 +date: 2023-08-02 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.35.2...v0.35.3 diff --git a/changelog/wave/v0.36.0.mdx b/changelog/wave/v0.36.0.mdx new file mode 100644 index 000000000..55067dcbf --- /dev/null +++ b/changelog/wave/v0.36.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.36.0 +date: 2023-08-06 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.35.3...v0.36.0 diff --git a/changelog/wave/v0.36.1.mdx b/changelog/wave/v0.36.1.mdx new file mode 100644 index 000000000..4862bf09d --- /dev/null +++ b/changelog/wave/v0.36.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.36.1 +date: 2023-08-11 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.36.0...v0.36.1 diff --git a/changelog/wave/v0.37.0.mdx b/changelog/wave/v0.37.0.mdx new file mode 100644 index 000000000..561baba87 --- /dev/null +++ b/changelog/wave/v0.37.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.37.0 +date: 2023-08-14 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.36.1...v0.37.0 diff --git a/changelog/wave/v0.37.1.mdx b/changelog/wave/v0.37.1.mdx new file mode 100644 index 000000000..0be4d23f1 --- /dev/null +++ b/changelog/wave/v0.37.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.37.1 +date: 2023-08-15 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.37.0...v0.37.1 diff --git a/changelog/wave/v0.38.0.mdx b/changelog/wave/v0.38.0.mdx new file mode 100644 index 000000000..d5753e3e7 --- /dev/null +++ b/changelog/wave/v0.38.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.38.0 +date: 2023-08-19 +tags: [wave] +--- + +## Feature updates and improvements + +- Support for handling .dockerignore patterns added in wave-util by @munishchouhan in https://github.com/seqeralabs/wave/pull/281 +- Add support for build for Singularity images by @pditommaso in https://github.com/seqeralabs/wave/pull/282 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.37.1...v0.38.0 diff --git a/changelog/wave/v0.39.0.mdx b/changelog/wave/v0.39.0.mdx new file mode 100644 index 000000000..30ed06bb9 --- /dev/null +++ b/changelog/wave/v0.39.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.39.0 +date: 2023-08-24 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.38.0...v0.39.0 diff --git a/changelog/wave/v0.40.0.mdx b/changelog/wave/v0.40.0.mdx new file mode 100644 index 000000000..8e1d8bf36 --- /dev/null +++ b/changelog/wave/v0.40.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.40.0 +date: 2023-08-26 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.39.0...v0.40.0 diff --git a/changelog/wave/v0.40.1.mdx b/changelog/wave/v0.40.1.mdx new file mode 100644 index 000000000..2cc4f23dc --- /dev/null +++ b/changelog/wave/v0.40.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.40.1 +date: 2023-08-30 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.40.0...v0.40.1 diff --git a/changelog/wave/v0.40.2.mdx b/changelog/wave/v0.40.2.mdx new file mode 100644 index 000000000..05df3a9ec --- /dev/null +++ b/changelog/wave/v0.40.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.40.2 +date: 2023-08-31 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.40.1...v0.40.2 diff --git a/changelog/wave/v0.40.3.mdx b/changelog/wave/v0.40.3.mdx new file mode 100644 index 000000000..0c65639cf --- /dev/null +++ b/changelog/wave/v0.40.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.40.3 +date: 2023-09-02 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.40.2...v0.40.3 diff --git a/changelog/wave/v0.41.0.mdx b/changelog/wave/v0.41.0.mdx new file mode 100644 index 000000000..49453bc4a --- /dev/null +++ b/changelog/wave/v0.41.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.41.0 +date: 2023-09-07 +tags: [wave] +--- + +## Feature updates and improvements + +- Support added for spack packages for singularity builds by @munishchouhan in https://github.com/seqeralabs/wave/pull/288 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.40.3...v0.41.0 diff --git a/changelog/wave/v0.41.1.mdx b/changelog/wave/v0.41.1.mdx new file mode 100644 index 000000000..b84881a01 --- /dev/null +++ b/changelog/wave/v0.41.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.41.1 +date: 2023-09-14 +tags: [wave] +--- + +## Feature updates and improvements + +- Remove unwanted code from singularity spack build by @munishchouhan in https://github.com/seqeralabs/wave/pull/293 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.0...v0.41.1 diff --git a/changelog/wave/v0.41.10.mdx b/changelog/wave/v0.41.10.mdx new file mode 100644 index 000000000..aaee85d5c --- /dev/null +++ b/changelog/wave/v0.41.10.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.10 +date: 2023-10-01T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.9...v0.41.10 diff --git a/changelog/wave/v0.41.11.mdx b/changelog/wave/v0.41.11.mdx new file mode 100644 index 000000000..afaa49c39 --- /dev/null +++ b/changelog/wave/v0.41.11.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.11 +date: 2023-10-01T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.10...v0.41.11 diff --git a/changelog/wave/v0.41.12.mdx b/changelog/wave/v0.41.12.mdx new file mode 100644 index 000000000..5b7137db8 --- /dev/null +++ b/changelog/wave/v0.41.12.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.12 +date: 2023-10-01T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.11...v0.41.12 diff --git a/changelog/wave/v0.41.13.mdx b/changelog/wave/v0.41.13.mdx new file mode 100644 index 000000000..0a06f99d1 --- /dev/null +++ b/changelog/wave/v0.41.13.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.13 +date: 2023-10-02 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.12...v0.41.13 diff --git a/changelog/wave/v0.41.2.mdx b/changelog/wave/v0.41.2.mdx new file mode 100644 index 000000000..391a87004 --- /dev/null +++ b/changelog/wave/v0.41.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.2 +date: 2023-09-20 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.1...v0.41.2 diff --git a/changelog/wave/v0.41.3.mdx b/changelog/wave/v0.41.3.mdx new file mode 100644 index 000000000..91a7a845e --- /dev/null +++ b/changelog/wave/v0.41.3.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.3 +date: 2023-09-22 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.2...v0.41.3 diff --git a/changelog/wave/v0.41.4.mdx b/changelog/wave/v0.41.4.mdx new file mode 100644 index 000000000..1dfb84109 --- /dev/null +++ b/changelog/wave/v0.41.4.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.41.4 +date: 2023-09-23 +tags: [wave] +--- + +## What's Changed + +- Added virtual thread executor in httpclient factory by @munishchouhan in https://github.com/seqeralabs/wave/pull/290 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.3...v0.41.4 diff --git a/changelog/wave/v0.41.5.mdx b/changelog/wave/v0.41.5.mdx new file mode 100644 index 000000000..7273af053 --- /dev/null +++ b/changelog/wave/v0.41.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.5 +date: 2023-09-25 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.4...v0.41.5 diff --git a/changelog/wave/v0.41.6.mdx b/changelog/wave/v0.41.6.mdx new file mode 100644 index 000000000..6f33c5e9f --- /dev/null +++ b/changelog/wave/v0.41.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.6 +date: 2023-09-28T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.5...v0.41.6 diff --git a/changelog/wave/v0.41.7.mdx b/changelog/wave/v0.41.7.mdx new file mode 100644 index 000000000..3d91bae4b --- /dev/null +++ b/changelog/wave/v0.41.7.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.7 +date: 2023-09-28T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.6...v0.41.7 diff --git a/changelog/wave/v0.41.8.mdx b/changelog/wave/v0.41.8.mdx new file mode 100644 index 000000000..87da34ea3 --- /dev/null +++ b/changelog/wave/v0.41.8.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.8 +date: 2023-09-29 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.7...v0.41.8 diff --git a/changelog/wave/v0.41.9.mdx b/changelog/wave/v0.41.9.mdx new file mode 100644 index 000000000..1f4638a87 --- /dev/null +++ b/changelog/wave/v0.41.9.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.41.9 +date: 2023-09-30 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.8...v0.41.9 diff --git a/changelog/wave/v0.42.0.mdx b/changelog/wave/v0.42.0.mdx new file mode 100644 index 000000000..eb2aa3713 --- /dev/null +++ b/changelog/wave/v0.42.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v0.42.0 +date: 2023-10-04T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add support for s3 hosted spack binary cache by @munishchouhan in https://github.com/seqeralabs/wave/pull/294 +- Add support for S3 hosted Spack binary cache (#294) by @pditommaso in https://github.com/seqeralabs/wave/pull/304 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.41.13...v0.42.0 diff --git a/changelog/wave/v0.43.0.mdx b/changelog/wave/v0.43.0.mdx new file mode 100644 index 000000000..419c41460 --- /dev/null +++ b/changelog/wave/v0.43.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.43.0 +date: 2023-10-07T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.42.0...v0.43.0 diff --git a/changelog/wave/v0.43.1.mdx b/changelog/wave/v0.43.1.mdx new file mode 100644 index 000000000..e654c576e --- /dev/null +++ b/changelog/wave/v0.43.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.43.1 +date: 2023-10-12T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.43.0...v0.43.1 diff --git a/changelog/wave/v0.8.0.mdx b/changelog/wave/v0.8.0.mdx new file mode 100644 index 000000000..45f2bea59 --- /dev/null +++ b/changelog/wave/v0.8.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.8.0 +date: 2022-08-06T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Feature: initial documentation by @jorgeaguileraseqera in https://github.com/seqeralabs/wave/pull/66 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.7.1...v0.8.0 diff --git a/changelog/wave/v0.9.0.mdx b/changelog/wave/v0.9.0.mdx new file mode 100644 index 000000000..1842f14f3 --- /dev/null +++ b/changelog/wave/v0.9.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v0.9.0 +date: 2022-08-06T11:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Registry authorisation & credentials refactor by @pditommaso in https://github.com/seqeralabs/wave/pull/71 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.8.0...v0.9.0 diff --git a/changelog/wave/v0.9.1.mdx b/changelog/wave/v0.9.1.mdx new file mode 100644 index 000000000..d16a406ba --- /dev/null +++ b/changelog/wave/v0.9.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v0.9.1 +date: 2022-08-06T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.9.0...v0.9.1 diff --git a/changelog/wave/v1.0.0.mdx b/changelog/wave/v1.0.0.mdx new file mode 100644 index 000000000..4479e5c0c --- /dev/null +++ b/changelog/wave/v1.0.0.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.0.0 +date: 2023-10-16 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v0.43.1...v1.0.0 diff --git a/changelog/wave/v1.0.1.mdx b/changelog/wave/v1.0.1.mdx new file mode 100644 index 000000000..10d797f07 --- /dev/null +++ b/changelog/wave/v1.0.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.0.1 +date: 2023-10-17 +tags: [wave] +--- + +## Feature updates and improvements + +- New logos by @pditommaso in https://github.com/seqeralabs/wave/pull/311 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.0.0...v1.0.1 diff --git a/changelog/wave/v1.0.2.mdx b/changelog/wave/v1.0.2.mdx new file mode 100644 index 000000000..94569a785 --- /dev/null +++ b/changelog/wave/v1.0.2.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.0.2 +date: 2023-10-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Deny path filter added by @munishchouhan in https://github.com/seqeralabs/wave/pull/313 +- Enable reuse in spack by @munishchouhan in https://github.com/seqeralabs/wave/pull/317 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.0.1...v1.0.2 diff --git a/changelog/wave/v1.1.0.mdx b/changelog/wave/v1.1.0.mdx new file mode 100644 index 000000000..6e4676574 --- /dev/null +++ b/changelog/wave/v1.1.0.mdx @@ -0,0 +1,22 @@ +--- +title: Wave v1.1.0 +date: 2023-11-10 +tags: [wave] +--- + +## Feature updates and improvements + +- License checksum validation added by @munishchouhan in https://github.com/seqeralabs/wave/pull/265 +- Fix/wavespack quiet filestrip by @marcodelapierre in https://github.com/seqeralabs/wave/pull/321 +- Build error fixed by @munishchouhan in https://github.com/seqeralabs/wave/pull/322 +- Build success condition removed from store log to s3 bucket by @munishchouhan in https://github.com/seqeralabs/wave/pull/328 +- Add tower endpoint by @jason-seqera in https://github.com/seqeralabs/wave/pull/329 +- Copy latest docs changes by @jason-seqera in https://github.com/seqeralabs/wave/pull/319 +- Add support for ARM architecture for Singularity build (#286) by @pditommaso in https://github.com/seqeralabs/wave/pull/325 + +## New Contributors + +- @marcodelapierre made their first contribution in https://github.com/seqeralabs/wave/pull/321 +- @jason-seqera made their first contribution in https://github.com/seqeralabs/wave/pull/329 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.0.2...v1.1.0 diff --git a/changelog/wave/v1.1.1.mdx b/changelog/wave/v1.1.1.mdx new file mode 100644 index 000000000..e2e6bc173 --- /dev/null +++ b/changelog/wave/v1.1.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.1.1 +date: 2023-11-16 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.0...v1.1.1 diff --git a/changelog/wave/v1.1.2.mdx b/changelog/wave/v1.1.2.mdx new file mode 100644 index 000000000..837c1e958 --- /dev/null +++ b/changelog/wave/v1.1.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.1.2 +date: 2023-11-19 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.1...v1.1.2 diff --git a/changelog/wave/v1.1.3.mdx b/changelog/wave/v1.1.3.mdx new file mode 100644 index 000000000..60daffa56 --- /dev/null +++ b/changelog/wave/v1.1.3.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.1.3 +date: 2023-11-24 +tags: [wave] +--- + +## Feature updates and improvements + +- Improve error reporting for TimedInputStream exceptions [c8895326] +- Fix Container 302 redirect response with body [1a90cbc2] +- Bump gradle to 8.4 (#337) [227002fb] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.2...v1.1.3 diff --git a/changelog/wave/v1.1.4.mdx b/changelog/wave/v1.1.4.mdx new file mode 100644 index 000000000..2fab178ba --- /dev/null +++ b/changelog/wave/v1.1.4.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.1.4 +date: 2023-11-25 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.3...v1.1.4 diff --git a/changelog/wave/v1.1.5.mdx b/changelog/wave/v1.1.5.mdx new file mode 100644 index 000000000..ce322e998 --- /dev/null +++ b/changelog/wave/v1.1.5.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.1.5 +date: 2023-11-27 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.4...v1.1.5 diff --git a/changelog/wave/v1.1.6.mdx b/changelog/wave/v1.1.6.mdx new file mode 100644 index 000000000..d5127d945 --- /dev/null +++ b/changelog/wave/v1.1.6.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.1.6 +date: 2023-12-11 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.5...v1.1.6 diff --git a/changelog/wave/v1.1.7.mdx b/changelog/wave/v1.1.7.mdx new file mode 100644 index 000000000..c1ecb3125 --- /dev/null +++ b/changelog/wave/v1.1.7.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v1.1.7 +date: 2023-12-19 +tags: [wave] +--- + +## Feature updates and improvements + +- Add all build configuration in a single config class by @munishchouhan in https://github.com/seqeralabs/wave/pull/324 +- Simplify sidebar slightly by @jason-seqera in https://github.com/seqeralabs/wave/pull/350 +- Add visibility into API rate limits by @jason-seqera in https://github.com/seqeralabs/wave/pull/348 +- Remove GitHub workflows for legacy docs site by @jason-seqera in https://github.com/seqeralabs/wave/pull/349 +- Use cr.seqera.io/public/docs-previewer image by @jason-seqera in https://github.com/seqeralabs/wave/pull/352 +- Proxy client v4 by @pditommaso in https://github.com/seqeralabs/wave/pull/358 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.5...v1.1.7 diff --git a/changelog/wave/v1.10.0.mdx b/changelog/wave/v1.10.0.mdx new file mode 100644 index 000000000..b5a8cd4fc --- /dev/null +++ b/changelog/wave/v1.10.0.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v1.10.0 +date: 2024-07-25 +tags: [wave] +--- + +## Feature updates and improvements + +- Enable Cleanup for blob transfer pods by @munishchouhan in https://github.com/seqeralabs/wave/pull/568 +- Updated Wave license note by @justinegeffen in https://github.com/seqeralabs/wave/pull/570 +- Use k8s job for blob cache transfer by @munishchouhan in https://github.com/seqeralabs/wave/pull/479 +- Extend build timeout by @pditommaso in https://github.com/seqeralabs/wave/pull/574 +- Add delete after finish to blob cache jobs by @pditommaso in https://github.com/seqeralabs/wave/pull/576 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.9.0...v1.10.0 diff --git a/changelog/wave/v1.10.1.mdx b/changelog/wave/v1.10.1.mdx new file mode 100644 index 000000000..5b3146582 --- /dev/null +++ b/changelog/wave/v1.10.1.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.10.1 +date: 2024-07-26 +tags: [wave] +--- + +## Feature updates and improvements + +- Improve error report by @pditommaso in https://github.com/seqeralabs/wave/pull/579 +- Add second level cache for Registry auth record by @pditommaso in https://github.com/seqeralabs/wave/pull/582 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.0...v1.10.1 diff --git a/changelog/wave/v1.10.2.mdx b/changelog/wave/v1.10.2.mdx new file mode 100644 index 000000000..5ad1d3172 --- /dev/null +++ b/changelog/wave/v1.10.2.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.10.2 +date: 2024-08-03 +tags: [wave] +--- + +## Feature updates and improvements + +- Add second level cache in RegistryAuthService by @munishchouhan in https://github.com/seqeralabs/wave/pull/588 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.1...v1.10.2 diff --git a/changelog/wave/v1.10.3.mdx b/changelog/wave/v1.10.3.mdx new file mode 100644 index 000000000..0b74dcacb --- /dev/null +++ b/changelog/wave/v1.10.3.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.10.3 +date: 2024-08-05 +tags: [wave] +--- + +## Feature updates and improvements + +- Added remove from redis in invalidateAuthorization by @munishchouhan in https://github.com/seqeralabs/wave/pull/591 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.2...v1.10.3 diff --git a/changelog/wave/v1.10.4.mdx b/changelog/wave/v1.10.4.mdx new file mode 100644 index 000000000..efa7e0a19 --- /dev/null +++ b/changelog/wave/v1.10.4.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.10.4 +date: 2024-08-06 +tags: [wave] +--- + +## Feature updates and improvements + +- Remove contentreader and contentreaderfactory classes by @munishchouhan in https://github.com/seqeralabs/wave/pull/584 +- Add second level cache in RegistryAuthService by @munishchouhan in https://github.com/seqeralabs/wave/pull/588 +- Added remove from redis in invalidateAuthorization by @munishchouhan in https://github.com/seqeralabs/wave/pull/591 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.1...v1.10.4 diff --git a/changelog/wave/v1.11.0.mdx b/changelog/wave/v1.11.0.mdx new file mode 100644 index 000000000..7f1f48fc8 --- /dev/null +++ b/changelog/wave/v1.11.0.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v1.11.0 +date: 2024-08-23 +tags: [wave] +--- + +## Feature updates and improvements + +- Add /v1alpha2/container/{containerId} (#609) [5221b5a0] +- Improve contaiener view page (#615) [9e15b455] +- Fix too many requests error code (#610) [cc9fa23f] +- Add trusted builds timeout (#600) [7500fc5f] +- Change k8s Job deletion to foreground pods propagation (#595) [816bd6b4] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.4...v1.11.0 diff --git a/changelog/wave/v1.11.1.mdx b/changelog/wave/v1.11.1.mdx new file mode 100644 index 000000000..0921a3e2d --- /dev/null +++ b/changelog/wave/v1.11.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.11.1 +date: 2024-09-05 +tags: [wave] +--- + +## Feature updates and improvements + +- Add rate limiter to container request [a3c63525] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.11.0...v1.11.1 diff --git a/changelog/wave/v1.12.0.mdx b/changelog/wave/v1.12.0.mdx new file mode 100644 index 000000000..d623512ff --- /dev/null +++ b/changelog/wave/v1.12.0.mdx @@ -0,0 +1,51 @@ +--- +title: Wave v1.12.0 +date: 2024-09-17T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Change k8s delete job propogation policy to foreground by @munishchouhan in https://github.com/seqeralabs/wave/pull/595 +- Improve blob cache reliability by @pditommaso in https://github.com/seqeralabs/wave/pull/596 +- Add trusted builds timeout by @pditommaso in https://github.com/seqeralabs/wave/pull/600 +- Update wave rate limits by @gavinelder in https://github.com/seqeralabs/wave/pull/606 +- Refresh Wave documentation by @jason-seqera in https://github.com/seqeralabs/wave/pull/516 +- Fix docs link by @jason-seqera in https://github.com/seqeralabs/wave/pull/611 +- Fix outdated Platform docs URLs on nextflow.mdx by @llewellyn-sl in https://github.com/seqeralabs/wave/pull/612 +- Links to Platform docs must be external to resolve by @jason-seqera in https://github.com/seqeralabs/wave/pull/613 +- Fix too many requests error by @pditommaso in https://github.com/seqeralabs/wave/pull/610 +- Improve container view page by @pditommaso in https://github.com/seqeralabs/wave/pull/615 +- Add /v1alpha2/container/{token} by @munishchouhan in https://github.com/seqeralabs/wave/pull/609 +- Add GET /v1alpha2/container/{token} in typespec by @munishchouhan in https://github.com/seqeralabs/wave/pull/618 +- Add Job manager by @pditommaso in https://github.com/seqeralabs/wave/pull/605 +- Add build in progress status in build page by @munishchouhan in https://github.com/seqeralabs/wave/pull/607 +- Add bioinf example in docs by @munishchouhan in https://github.com/seqeralabs/wave/pull/621 +- Converge job service by @pditommaso in https://github.com/seqeralabs/wave/pull/620 +- Simplify tests by @pditommaso in https://github.com/seqeralabs/wave/pull/627 +- Improve registry auth error handling by @pditommaso in https://github.com/seqeralabs/wave/pull/628 +- Fix Retry policy delay multiplier by @pditommaso in https://github.com/seqeralabs/wave/pull/629 +- Do not retry on build failure by @pditommaso in https://github.com/seqeralabs/wave/pull/632 +- Fix K8s job status detection by @pditommaso in https://github.com/seqeralabs/wave/pull/630 +- Remove unneeded timeout logic by @pditommaso in https://github.com/seqeralabs/wave/pull/633 +- Deferred resources cleanup by @pditommaso in https://github.com/seqeralabs/wave/pull/636 +- Add containerImage in scan by @munishchouhan in https://github.com/seqeralabs/wave/pull/635 +- Use public repo for s5cmd by @pditommaso in https://github.com/seqeralabs/wave/pull/639 +- Bump trivy 0.55 by @pditommaso in https://github.com/seqeralabs/wave/pull/638 +- Update scan model by @pditommaso in https://github.com/seqeralabs/wave/pull/637 +- Add entropy to cron services by @pditommaso in https://github.com/seqeralabs/wave/pull/640 +- Increase cache-tower-client to 1min by @pditommaso in https://github.com/seqeralabs/wave/pull/641 +- Fix failure duration by @pditommaso in https://github.com/seqeralabs/wave/pull/643 +- Improve blob cache info by @pditommaso in https://github.com/seqeralabs/wave/pull/644 +- Improve job dispatcher by @pditommaso in https://github.com/seqeralabs/wave/pull/645 +- Run docker process in background by @pditommaso in https://github.com/seqeralabs/wave/pull/647 + +## Breaking changes + +- Build status records used by this version are not compatible 1.11.x and earlier versions. **No builds should be running while deploying this version** + +## New Contributors + +- @gavinelder made their first contribution in https://github.com/seqeralabs/wave/pull/606 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.10.4...v1.12.0 diff --git a/changelog/wave/v1.12.1.mdx b/changelog/wave/v1.12.1.mdx new file mode 100644 index 000000000..91152bfbb --- /dev/null +++ b/changelog/wave/v1.12.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.12.1 +date: 2024-09-17T12:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix stream check for new messages [16a7e256] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.12.0...v1.12.1 diff --git a/changelog/wave/v1.12.2.mdx b/changelog/wave/v1.12.2.mdx new file mode 100644 index 000000000..3c4930834 --- /dev/null +++ b/changelog/wave/v1.12.2.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.12.2 +date: 2024-09-18 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix Remove entries permanently from stream once consumed [adfad9d6] +- Refactor container build service [1a858c12] +- Remove unused code [268c76ea] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.12.1...v1.12.2 diff --git a/changelog/wave/v1.12.3.mdx b/changelog/wave/v1.12.3.mdx new file mode 100644 index 000000000..fcc5e9b8e --- /dev/null +++ b/changelog/wave/v1.12.3.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.12.3 +date: 2024-09-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix build status completion of submit exception [3c3af360] +- Fix singularity build mounts [3b338b29] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.12.2...v1.12.3 diff --git a/changelog/wave/v1.12.4.mdx b/changelog/wave/v1.12.4.mdx index 72c75a61d..4cf619880 100644 --- a/changelog/wave/v1.12.4.mdx +++ b/changelog/wave/v1.12.4.mdx @@ -4,8 +4,8 @@ date: 2024-09-26 tags: [wave] --- -- Fix build succeded & status response [8a760b39](https://github.com/seqeralabs/wave/commit/8a760b39283800d3331ea7cfac2648a748c15571) +## Feature updates and improvements -{/* truncate */} +- Fix build succeded & status response [8a760b39](https://github.com/seqeralabs/wave/commit/8a760b39283800d3331ea7cfac2648a748c15571) **Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.12.3...v1.12.4 diff --git a/changelog/wave/v1.13.0.mdx b/changelog/wave/v1.13.0.mdx new file mode 100644 index 000000000..7d9c2ff61 --- /dev/null +++ b/changelog/wave/v1.13.0.mdx @@ -0,0 +1,38 @@ +--- +title: Wave v1.13.0 +date: 2024-10-14 +tags: [wave] +--- + +## Feature updates and improvements + +- Add inspect view by @munishchouhan in #619 +- Fix-inspect-test by @munishchouhan in #652 +- Remove BiCacheStore data structure by @pditommaso in #653 +- Remove spack by @pditommaso in #601 +- Improve handling build id in view page by @pditommaso in #651 +- Container mirror by @pditommaso in #646 +- Fix compile error by @munishchouhan in #659 +- Refactor state store components by @pditommaso in #657 +- Improve inspect for multi platform container images by @munishchouhan in #660 +- Remove deprecated keyId by @pditommaso in #616 +- Add code coverage report to build by @pditommaso in #661 +- Fix repository creds check by @pditommaso in #665 +- Fix entity too large by @munishchouhan in #658 +- Add better pool handling for Jackson mapper objects by @pditommaso in #666 +- Add type spec for container mirror by @munishchouhan in #669 +- Fix mirror typespec by @munishchouhan in #670 +- Scan v2 by @pditommaso in #662 +- Add support for conda lock file by @munishchouhan in #642 +- Add copy button and scroll bars in views by @munishchouhan in #674 +- Add Typespec for container mirror and status by @munishchouhan in #677 +- Fix Deserialization exception on WaveScanRecord by @munishchouhan in #679 +- Add download icon and updated copy icon by @munishchouhan in #678 +- Remove ip address by @pditommaso in #680 +- Refactor MirrorConfig by @munishchouhan in #668 +- Bump AWS sdk 2.28.15 by @pditommaso in #667 +- Remove monospace from by @munishchouhan in #683 +- Fix exception when there is no conda lockfile by @munishchouhan in #685 +- Fix container view by @munishchouhan in #686 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.12.4...v1.13.0 diff --git a/changelog/wave/v1.13.1.mdx b/changelog/wave/v1.13.1.mdx new file mode 100644 index 000000000..4b90fce1b --- /dev/null +++ b/changelog/wave/v1.13.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.13.1 +date: 2024-10-15T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix conda lock download by @pditommaso in [0e86c4](https://github.com/seqeralabs/wave/commit/0e86c4a3a19b1838af40282c00986a89d623cf3e) + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.0...v1.13.1 diff --git a/changelog/wave/v1.13.10.mdx b/changelog/wave/v1.13.10.mdx new file mode 100644 index 000000000..ccd92d52b --- /dev/null +++ b/changelog/wave/v1.13.10.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.13.10 +date: 2024-10-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Log slow processing stream messages [e8a6b7ee] +- Prevent scan when mode is not defined [d42bcae1] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.9...v1.13.10 diff --git a/changelog/wave/v1.13.11.mdx b/changelog/wave/v1.13.11.mdx new file mode 100644 index 000000000..bb4e2de67 --- /dev/null +++ b/changelog/wave/v1.13.11.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.13.11 +date: 2024-11-02 +tags: [wave] +--- + +## Feature updates and improvements + +- Bump org.apache.commons:commons-compress:1.27.1 by @munishchouhan in https://github.com/seqeralabs/wave/pull/722 +- Cap number of scan vulnerabilities reported by @munishchouhan in https://github.com/seqeralabs/wave/pull/728 +- Save scan record async by @pditommaso in https://github.com/seqeralabs/wave/pull/730 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.10...v1.13.11 diff --git a/changelog/wave/v1.13.2.mdx b/changelog/wave/v1.13.2.mdx new file mode 100644 index 000000000..9c89f1ad6 --- /dev/null +++ b/changelog/wave/v1.13.2.mdx @@ -0,0 +1,14 @@ +--- +title: Wave v1.13.2 +date: 2024-10-15T12:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Propagate container platform with freeze by @pditommaso in https://github.com/seqeralabs/wave/pull/692 +- Add link to inspect from build view by @pditommaso in https://github.com/seqeralabs/wave/pull/695 +- Fix empty array plus icon by @munishchouhan in https://github.com/seqeralabs/wave/pull/697 +- Add builds-view to show the list of builds for a given container id by @munishchouhan in https://github.com/seqeralabs/wave/pull/696 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.1...v1.13.2 diff --git a/changelog/wave/v1.13.3.mdx b/changelog/wave/v1.13.3.mdx new file mode 100644 index 000000000..ab983a62f --- /dev/null +++ b/changelog/wave/v1.13.3.mdx @@ -0,0 +1,14 @@ +--- +title: Wave v1.13.3 +date: 2024-10-18 +tags: [wave] +--- + +## Feature updates and improvements + +- Capture usage metrics for scan and mirrors by @munishchouhan in https://github.com/seqeralabs/wave/pull/699 +- Improve build history view by @munishchouhan in https://github.com/seqeralabs/wave/pull/701 +- Add Github token to scan job env by @pditommaso in https://github.com/seqeralabs/wave/pull/703 +- Added list of scan for a given partial scanId by @munishchouhan in https://github.com/seqeralabs/wave/pull/704 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.2...v1.13.3 diff --git a/changelog/wave/v1.13.4.mdx b/changelog/wave/v1.13.4.mdx new file mode 100644 index 000000000..e061a6ed7 --- /dev/null +++ b/changelog/wave/v1.13.4.mdx @@ -0,0 +1,17 @@ +--- +title: Wave v1.13.4 +date: 2024-10-20 +tags: [wave] +--- + +## Feature updates and improvements + +- Add scan failure duration setting (#705) [372d6dec] +- Change scan config log to info [f382c51a] +- Copy all tags on mirror request [20a5f7b5] +- Fix dev scan failure dutation & GH token [f5711ff8] +- Fix use of container platform in scan job [61df2424] +- Fix Prevent rendereing image names as uri in mail notication [f8d57921] +- Fix Tune mirror config [f7290bd5] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.3...v1.13.4 diff --git a/changelog/wave/v1.13.5.mdx b/changelog/wave/v1.13.5.mdx new file mode 100644 index 000000000..93a70d0af --- /dev/null +++ b/changelog/wave/v1.13.5.mdx @@ -0,0 +1,20 @@ +--- +title: Wave v1.13.5 +date: 2024-10-23 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix Do not render inspect url on fail [d96275a1] +- Fix inspect view empty nodes (#706) [b3473b7e] +- Fix prevent scan on cached failed builds [4473fe8c] +- Use JedisPool in place of generic connection pool (#711) [cd16cfd1] +- Minor page title change [c3be9304] +- GHA to submit dependency graph to Github (#715) [09c86627] + +## New Contributors + +- @arnaualcazar made their first contribution in https://github.com/seqeralabs/wave/pull/715 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.4...v1.13.5 diff --git a/changelog/wave/v1.13.6.mdx b/changelog/wave/v1.13.6.mdx new file mode 100644 index 000000000..5d4c4a7d9 --- /dev/null +++ b/changelog/wave/v1.13.6.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.13.6 +date: 2024-10-25T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add scan color for different vuls by @munishchouhan in https://github.com/seqeralabs/wave/pull/719 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.5...v1.13.6 diff --git a/changelog/wave/v1.13.7.mdx b/changelog/wave/v1.13.7.mdx new file mode 100644 index 000000000..db23396b5 --- /dev/null +++ b/changelog/wave/v1.13.7.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.13.7 +date: 2024-10-25T12:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Add ability to configure trivy dbs by @pditommaso in https://github.com/seqeralabs/wave/pull/720 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.6...v1.13.7 diff --git a/changelog/wave/v1.13.8.mdx b/changelog/wave/v1.13.8.mdx new file mode 100644 index 000000000..6a6bf3f0b --- /dev/null +++ b/changelog/wave/v1.13.8.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.13.8 +date: 2024-10-26 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix update scan status synchronously [e767c367] +- Bump scan warn colour [705141f0] +- Improve scan logging [f01e4dba] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.7...v1.13.8 diff --git a/changelog/wave/v1.13.9.mdx b/changelog/wave/v1.13.9.mdx new file mode 100644 index 000000000..f72c1d557 --- /dev/null +++ b/changelog/wave/v1.13.9.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.13.9 +date: 2024-10-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix inspect view by @munishchouhan in https://github.com/seqeralabs/wave/pull/724 +- Fix inspect view by @munishchouhan in https://github.com/seqeralabs/wave/pull/725 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.8...v1.13.9 diff --git a/changelog/wave/v1.14.0.mdx b/changelog/wave/v1.14.0.mdx new file mode 100644 index 000000000..dd808ce4a --- /dev/null +++ b/changelog/wave/v1.14.0.mdx @@ -0,0 +1,22 @@ +--- +title: Wave v1.14.0 +date: 2024-11-10 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix K8s env propagation [76f0a456] +- Remove deprecated K8s methods (#734) [481298bf] +- Bump to Micronaut 4.6 (#318) [f67e8556] +- Bump Java 21 as build requirement (#519) [132f9491] +- Bump bitbucket.b_c:jose4j:0.9.4 [2e10416a] +- Bump bouncycastle:bcpkix-jdk18on:1.78 [ede22ce5] +- Bump jedis 5.1.3 (#732) [2ee0854e] +- Bump logback 1.5.12 [f5fe3fa4] +- Bump make deps runtimeclasspath [2a342b18] +- Bump snakeyaml 2.2 [6aeb3c33] +- Bump spillway 3.0.0 (#731) [1502696d] +- Bump explicit dep to websocket module [2e413ac2] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.13.11...v1.14.0 diff --git a/changelog/wave/v1.14.1.mdx b/changelog/wave/v1.14.1.mdx new file mode 100644 index 000000000..c4573967a --- /dev/null +++ b/changelog/wave/v1.14.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.14.1 +date: 2024-11-14 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix creds validation endpoint by @pditommaso in https://github.com/seqeralabs/wave/pull/740 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.14.0...v1.14.1 diff --git a/changelog/wave/v1.15.0.mdx b/changelog/wave/v1.15.0.mdx new file mode 100644 index 000000000..070260003 --- /dev/null +++ b/changelog/wave/v1.15.0.mdx @@ -0,0 +1,18 @@ +--- +title: Wave v1.15.0 +date: 2024-11-18 +tags: [wave] +--- + +## Feature updates and improvements + +- Migration to virtual threads - phase 1 (#746) [aaf0420c] +- Use runAsync instead supplyAsync [ffd0dacd] +- Remove deprecated ThreadPoolBuilder [7af3046f] +- Replace Guava cache with Caffeine (#745) [cf813e0a] +- Update project deps [f24b684d] +- Bump guava to version 33.3.1-jre [328e9ea3] +- Bump Netty version 4.1.115.Final [9ba433ce] +- Bump Gradle 8.10.2 [52272fe1] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.14.1...v1.15.0 diff --git a/changelog/wave/v1.15.1.mdx b/changelog/wave/v1.15.1.mdx new file mode 100644 index 000000000..ac7fb372a --- /dev/null +++ b/changelog/wave/v1.15.1.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.15.1 +date: 2024-11-20 +tags: [wave] +--- + +## Feature updates and improvements + +- Check block existence with object operation (#750) [86ef526c] +- Add `/v1alpha2/validate-creds` endpoint (#752) [e24ec62c] +- Switch env vars around (#748) [080d5cce] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.15.0...v1.15.1 diff --git a/changelog/wave/v1.15.3.mdx b/changelog/wave/v1.15.3.mdx new file mode 100644 index 000000000..e91787201 --- /dev/null +++ b/changelog/wave/v1.15.3.mdx @@ -0,0 +1,18 @@ +--- +title: Wave v1.15.3 +date: 2024-11-25 +tags: [wave] +--- + +## Feature updates and improvements + +- Add Support Redis support for SSL and password (#717) [bf63599d] +- Bump MN 4.7.1 (#741) [203e5dd0] +- Remove double cache builder invocation [994b722c] +- Bump lib-mail version 1.2.1 [4da98a23] +- Bump io.seqera:lib-crypto [36f5b24d] +- Bump gson 2.10.1 [117703b9] +- Bump protobuf-java version 4.27.5 [3ea758b4] +- Bump k8s client to version 21.0.1 (#553) [51788578] + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.15.1...v1.15.3 diff --git a/changelog/wave/v1.15.4.mdx b/changelog/wave/v1.15.4.mdx new file mode 100644 index 000000000..9ced2503b --- /dev/null +++ b/changelog/wave/v1.15.4.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.15.4 +date: 2024-11-27 +tags: [wave] +--- + +## Feature updates and improvements + +- Add blocking executor to async caches by @pditommaso in https://github.com/seqeralabs/wave/pull/759 +- Add ExecutesOn annotation to error controller by @pditommaso in [a2db2b0](https://github.com/seqeralabs/wave/commit/a2db2b007effcaad4f5a38f3693f4b76b66e16ec) + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.15.3...v1.15.4 diff --git a/changelog/wave/v1.15.5.mdx b/changelog/wave/v1.15.5.mdx index abf9f6c47..0e5ebe69d 100644 --- a/changelog/wave/v1.15.5.mdx +++ b/changelog/wave/v1.15.5.mdx @@ -4,15 +4,15 @@ date: 2024-12-09 tags: [wave] --- -## New features and improvements +## Feature updates and improvements -* Workflow to sync changelog with Seqera docs by @vladsavelyev in https://github.com/seqeralabs/wave/pull/761 -* Fix docs sync changelog for manual dispatch trigger by @vladsavelyev in https://github.com/seqeralabs/wave/pull/766 -* Add Jedis pool metrics binder by @pditommaso in https://github.com/seqeralabs/wave/pull/756 -* Add support for common pool and vthread pool metrics by @pditommaso in https://github.com/seqeralabs/wave/pull/762 +- Workflow to sync changelog with Seqera docs by @vladsavelyev in https://github.com/seqeralabs/wave/pull/761 +- Fix docs sync changelog for manual dispatch trigger by @vladsavelyev in https://github.com/seqeralabs/wave/pull/766 +- Add Jedis pool metrics binder by @pditommaso in https://github.com/seqeralabs/wave/pull/756 +- Add support for common pool and vthread pool metrics by @pditommaso in https://github.com/seqeralabs/wave/pull/762 ## New contributors -* @vladsavelyev made their first contribution in https://github.com/seqeralabs/wave/pull/761 +- @vladsavelyev made their first contribution in https://github.com/seqeralabs/wave/pull/761 **Full changelog**: https://github.com/seqeralabs/wave/compare/v1.15.4...v1.15.5 diff --git a/changelog/wave/v1.16.0.mdx b/changelog/wave/v1.16.0.mdx index db2db37c1..e442946d7 100644 --- a/changelog/wave/v1.16.0.mdx +++ b/changelog/wave/v1.16.0.mdx @@ -4,11 +4,11 @@ date: 2024-12-17 tags: [wave] --- -## New features and improvements +## Feature updates and improvements -* Fix NPE while creating `PairingOutboundQueue` by @pditommaso in [https://github.com/seqeralabs/wave/pull/770](https://github.com/seqeralabs/wave/pull/770) -* Replace `volatile` with `final` by @pditommaso in [https://github.com/seqeralabs/wave/pull/771](https://github.com/seqeralabs/wave/pull/771) -* Fixed Conda lockfile rendering in build view by @munishchouhan in [https://github.com/seqeralabs/wave/pull/727](https://github.com/seqeralabs/wave/pull/727) -* Improve tower client caching by @pditommaso in [https://github.com/seqeralabs/wave/pull/772](https://github.com/seqeralabs/wave/pull/772) +- Fix NPE while creating `PairingOutboundQueue` by @pditommaso in [https://github.com/seqeralabs/wave/pull/770](https://github.com/seqeralabs/wave/pull/770) +- Replace `volatile` with `final` by @pditommaso in [https://github.com/seqeralabs/wave/pull/771](https://github.com/seqeralabs/wave/pull/771) +- Fixed Conda lockfile rendering in build view by @munishchouhan in [https://github.com/seqeralabs/wave/pull/727](https://github.com/seqeralabs/wave/pull/727) +- Improve tower client caching by @pditommaso in [https://github.com/seqeralabs/wave/pull/772](https://github.com/seqeralabs/wave/pull/772) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.15.5...v1.16.0](https://github.com/seqeralabs/wave/compare/v1.15.5...v1.16.0) diff --git a/changelog/wave/v1.16.1.mdx b/changelog/wave/v1.16.1.mdx index 7b3efda1d..d766db050 100644 --- a/changelog/wave/v1.16.1.mdx +++ b/changelog/wave/v1.16.1.mdx @@ -1,13 +1,13 @@ --- title: Wave v1.16.1 -date: 2024-12-20 +date: 2024-12-20T10:00 tags: [wave] --- -## New features and improvements +## Feature updates and improvements -- Add tiered cache for HTTP proxied responses (#778) [00b6add7] -- Improve bootstrap info [d5c086da] -- Remove Jitpack as Maven repository in Gradle build [67f91c8b] +- Add tiered cache for HTTP proxied responses by @pditommaso in [https://github.com/seqeralabs/wave/pull/778](https://github.com/seqeralabs/wave/pull/778) +- Improve bootstrap info by @pditommaso in [d5c086da](https://github.com/seqeralabs/wave/commit/d5c086dac3a41b1a3a4260ae84f980e58b579ace) +- Remove Jitpack as Maven repository in Gradle build by @pditommaso in [67f91c8b](https://github.com/seqeralabs/wave/commit/67f91c8b2ba7611eccf55cf45da5256e0465c59e) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.0...v1.16.1](https://github.com/seqeralabs/wave/compare/v1.16.0...v1.16.1) diff --git a/changelog/wave/v1.16.2.mdx b/changelog/wave/v1.16.2.mdx index 043202dbf..6caae5fee 100644 --- a/changelog/wave/v1.16.2.mdx +++ b/changelog/wave/v1.16.2.mdx @@ -1,11 +1,11 @@ --- title: Wave v1.16.2 -date: 2024-12-20 +date: 2024-12-20T12:00 tags: [wave] --- ## Feature updates and improvements -* Fix JWT token refresh by [@pditommaso](https://github.com/pditommaso) in [https://github.com/seqeralabs/wave/pull/512](https://github.com/seqeralabs/wave/pull/512) +- Fix JWT token refresh by @pditommaso in [https://github.com/seqeralabs/wave/pull/512](https://github.com/seqeralabs/wave/pull/512) **Full changelog**: [https://github.com/seqeralabs/wave/releases/tag/v1.16.2](https://github.com/seqeralabs/wave/releases/tag/v1.16.2) diff --git a/changelog/wave/v1.16.3.mdx b/changelog/wave/v1.16.3.mdx index a5ae94847..e4dfa1e00 100644 --- a/changelog/wave/v1.16.3.mdx +++ b/changelog/wave/v1.16.3.mdx @@ -6,6 +6,6 @@ tags: [wave] ## Feature updates and improvements -* Improve tiered cache by @pditommaso in [https://github.com/seqeralabs/wave/pull/779](https://github.com/seqeralabs/wave/pull/779) +- Improve tiered cache by @pditommaso in [https://github.com/seqeralabs/wave/pull/779](https://github.com/seqeralabs/wave/pull/779) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.2...v1.16.3](https://github.com/seqeralabs/wave/compare/v1.16.2...v1.16.3) diff --git a/changelog/wave/v1.16.4.mdx b/changelog/wave/v1.16.4.mdx index bc56779ad..2ac8fbfba 100644 --- a/changelog/wave/v1.16.4.mdx +++ b/changelog/wave/v1.16.4.mdx @@ -1,13 +1,13 @@ --- title: Wave v1.16.4 -date: 2024-12-30 +date: 2024-12-30T10:00 tags: [wave] --- -## Feature updates and improvements +## Feature updates and improvements -* Add trace execution elapsed time logic by @pditommaso in [https://github.com/seqeralabs/wave/pull/497](https://github.com/seqeralabs/wave/pull/497) -* Fix missing workspaceId in launch API by @pditommaso in [https://github.com/seqeralabs/wave/pull/780](https://github.com/seqeralabs/wave/pull/780) -* Remove unneeded user async api by @pditommaso in [https://github.com/seqeralabs/wave/pull/781](https://github.com/seqeralabs/wave/pull/781) +- Add trace execution elapsed time logic by @pditommaso in [https://github.com/seqeralabs/wave/pull/497](https://github.com/seqeralabs/wave/pull/497) +- Fix missing workspaceId in launch API by @pditommaso in [https://github.com/seqeralabs/wave/pull/780](https://github.com/seqeralabs/wave/pull/780) +- Remove unneeded user async api by @pditommaso in [https://github.com/seqeralabs/wave/pull/781](https://github.com/seqeralabs/wave/pull/781) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.3...v1.16.4](https://github.com/seqeralabs/wave/compare/v1.16.3...v1.16.4) diff --git a/changelog/wave/v1.16.5.mdx b/changelog/wave/v1.16.5.mdx index 70905e576..65807b233 100644 --- a/changelog/wave/v1.16.5.mdx +++ b/changelog/wave/v1.16.5.mdx @@ -1,11 +1,11 @@ --- title: Wave v1.16.5 -date: 2024-12-30 +date: 2024-12-30T12:00 tags: [wave] --- ## Feature updates and improvements -* Fix missing legacy classes deserialization by @pditommaso in [7687cd24](https://github.com/seqeralabs/wave/commit/7687cd242caef225842c0e0170db531d148be534) +- Fix missing legacy classes deserialization by @pditommaso in [7687cd24](https://github.com/seqeralabs/wave/commit/7687cd242caef225842c0e0170db531d148be534) **Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.16.4...v1.16.5 diff --git a/changelog/wave/v1.16.6.mdx b/changelog/wave/v1.16.6.mdx index bf3f1d213..513666d18 100644 --- a/changelog/wave/v1.16.6.mdx +++ b/changelog/wave/v1.16.6.mdx @@ -6,6 +6,6 @@ tags: [wave] ## Feature updates and improvements -* Use caffeine for tiered cache lock cache by @pditommaso in [https://github.com/seqeralabs/wave/pull/785](https://github.com/seqeralabs/wave/pull/785) +- Use caffeine for tiered cache lock cache by @pditommaso in [https://github.com/seqeralabs/wave/pull/785](https://github.com/seqeralabs/wave/pull/785) -**Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.5...v1.16.6](https://github.com/seqeralabs/wave/compare/v1.16.5...v1.16.6) +**Full changelog**: https://github.com/seqeralabs/wave/compare/v1.16.5...v1.16.6 diff --git a/changelog/wave/v1.16.7.mdx b/changelog/wave/v1.16.7.mdx index c89e42eeb..6c0dc2535 100644 --- a/changelog/wave/v1.16.7.mdx +++ b/changelog/wave/v1.16.7.mdx @@ -6,6 +6,6 @@ tags: [wave] ## Feature updates and improvements -* Improve logging on pairing websocket error by @pditommaso in [21861dbe](https://github.com/seqeralabs/wave/commit/21861dbe567a712111fec74130b681d3a8dbab70) +- Improve logging on pairing websocket error by @pditommaso in [21861dbe](https://github.com/seqeralabs/wave/commit/21861dbe567a712111fec74130b681d3a8dbab70) **Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.16.6...v1.16.7 diff --git a/changelog/wave/v1.16.8.mdx b/changelog/wave/v1.16.8.mdx index c712ad2d3..0e21cceac 100644 --- a/changelog/wave/v1.16.8.mdx +++ b/changelog/wave/v1.16.8.mdx @@ -6,10 +6,10 @@ tags: [wave] ## Feature updates and improvements -* Add TraceContextFilter logging context propagation by @pditommaso in [396c10c2](https://github.com/seqeralabs/wave/commit/396c10c2511222447785f6b8cd41d54ef34d022e -* Improve Proxy cache configuration by @pditommaso in [163e605f](https://github.com/seqeralabs/wave/commit/163e605f1927cec970ec7efcdf61058740f12661) -* Improve logging pattern by @pditommaso in [0ab87164](https://github.com/seqeralabs/wave/commit/0ab871648e6a4cb426e6e81ceb66e99c084a155d) -* Improve request caching logic by @pditommaso in [a95153be](https://github.com/seqeralabs/wave/commit/a95153bedfa79145f85c240d6b7b7a5903bba1da) -* Bump MN 4.7.4 by @pditommaso in [4ce2a139](https://github.com/seqeralabs/wave/commit/4ce2a1396f23135a819e2cd7426ed2d4f8a05e44) +- Add TraceContextFilter logging context propagation by @pditommaso in [396c10c2](https://github.com/seqeralabs/wave/commit/396c10c2511222447785f6b8cd41d54ef34d022e) +- Improve Proxy cache configuration by @pditommaso in [163e605f](https://github.com/seqeralabs/wave/commit/163e605f1927cec970ec7efcdf61058740f12661) +- Improve logging pattern by @pditommaso in [0ab87164](https://github.com/seqeralabs/wave/commit/0ab871648e6a4cb426e6e81ceb66e99c084a155d) +- Improve request caching logic by @pditommaso in [a95153be](https://github.com/seqeralabs/wave/commit/a95153bedfa79145f85c240d6b7b7a5903bba1da) +- Bump MN 4.7.4 by @pditommaso in [4ce2a139](https://github.com/seqeralabs/wave/commit/4ce2a1396f23135a819e2cd7426ed2d4f8a05e44) -**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.16.7...v1.16.8 +**Full Changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.7...v1.16.8](https://github.com/seqeralabs/wave/compare/v1.16.7...v1.16.8) diff --git a/changelog/wave/v1.17.0.mdx b/changelog/wave/v1.17.0.mdx index 24b4d06e5..4dbbbbbca 100644 --- a/changelog/wave/v1.17.0.mdx +++ b/changelog/wave/v1.17.0.mdx @@ -4,12 +4,11 @@ date: 2025-01-30 tags: [wave] --- -## New features and improvements - -* Bump buildkit to version 0.18.2 by @pditommaso in [https://github.com/seqeralabs/wave/pull/787](https://github.com/seqeralabs/wave/pull/787) -* Normalise URL in conda package while using them to generate target image by @munishchouhan in [https://github.com/seqeralabs/wave/pull/786](https://github.com/seqeralabs/wave/pull/786) -* Update docs by @munishchouhan in [https://github.com/seqeralabs/wave/pull/790](https://github.com/seqeralabs/wave/pull/790) -* Render html from openapi spec generated by typespec by @munishchouhan in [https://github.com/seqeralabs/wave/pull/707](https://github.com/seqeralabs/wave/pull/707) +## Feature updates and improvements +- Bump buildkit to version 0.18.2 by @pditommaso in [https://github.com/seqeralabs/wave/pull/787](https://github.com/seqeralabs/wave/pull/787) +- Normalise URL in conda package while using them to generate target image by @munishchouhan in [https://github.com/seqeralabs/wave/pull/786](https://github.com/seqeralabs/wave/pull/786) +- Update docs by @munishchouhan in [https://github.com/seqeralabs/wave/pull/790](https://github.com/seqeralabs/wave/pull/790) +- Render html from openapi spec generated by typespec by @munishchouhan in [https://github.com/seqeralabs/wave/pull/707](https://github.com/seqeralabs/wave/pull/707) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.16.8...v1.17.0](https://github.com/seqeralabs/wave/compare/v1.16.8...v1.17.0) diff --git a/changelog/wave/v1.17.1.mdx b/changelog/wave/v1.17.1.mdx index ddf430b93..34d48312e 100644 --- a/changelog/wave/v1.17.1.mdx +++ b/changelog/wave/v1.17.1.mdx @@ -6,7 +6,7 @@ tags: [wave] ## Feature updates and improvements -* Remove server from openapi spec by @munishchouhan in [https://github.com/seqeralabs/wave/pull/793](https://github.com/seqeralabs/wave/pull/793) -* Add container index support to inspect view by @pditommaso in [https://github.com/seqeralabs/wave/pull/792](https://github.com/seqeralabs/wave/pull/792) +- Remove server from openapi spec by @munishchouhan in [https://github.com/seqeralabs/wave/pull/793](https://github.com/seqeralabs/wave/pull/793) +- Add container index support to inspect view by @pditommaso in [https://github.com/seqeralabs/wave/pull/792](https://github.com/seqeralabs/wave/pull/792) **Full changelog**: [https://github.com/seqeralabs/wave/compare/v1.17.0...v1.17.1](https://github.com/seqeralabs/wave/compare/v1.17.0...v1.17.1) diff --git a/changelog/wave/v1.2.0.mdx b/changelog/wave/v1.2.0.mdx new file mode 100644 index 000000000..b6f540de7 --- /dev/null +++ b/changelog/wave/v1.2.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v1.2.0 +date: 2024-01-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Correct annotations processing package by @munishchouhan in https://github.com/seqeralabs/wave/pull/364 +- Copy back copy edits by @jason-seqera in https://github.com/seqeralabs/wave/pull/365 +- Change wave.build.public to wave.build.public-repo by @munishchouhan in https://github.com/seqeralabs/wave/pull/372 +- Build ci: accept slash in branch name by @marcodelapierre in https://github.com/seqeralabs/wave/pull/377 +- Container blob cache by @pditommaso in https://github.com/seqeralabs/wave/pull/359 +- Implement support for Cloudflare WAF token by @pditommaso in https://github.com/seqeralabs/wave/pull/383 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.1.7...v1.2.0 diff --git a/changelog/wave/v1.2.1.mdx b/changelog/wave/v1.2.1.mdx new file mode 100644 index 000000000..23c731447 --- /dev/null +++ b/changelog/wave/v1.2.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.2.1 +date: 2024-01-28 +tags: [wave] +--- + +## Feature updates and improvements + +- Implement Surreal fallback mechanism to allow migration to new version by @pditommaso in https://github.com/seqeralabs/wave/pull/388 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.2.0...v1.2.1 diff --git a/changelog/wave/v1.3.0.mdx b/changelog/wave/v1.3.0.mdx new file mode 100644 index 000000000..732265543 --- /dev/null +++ b/changelog/wave/v1.3.0.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.3.0 +date: 2024-02-09 +tags: [wave] +--- + +## Feature updates and improvements + +- Disable Wave http connector by @pditommaso in https://github.com/seqeralabs/wave/pull/384 +- Add support for container inclusions by @pditommaso in https://github.com/seqeralabs/wave/pull/397 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.2.1...v1.3.0 diff --git a/changelog/wave/v1.3.1.mdx b/changelog/wave/v1.3.1.mdx new file mode 100644 index 000000000..baebaafd8 --- /dev/null +++ b/changelog/wave/v1.3.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.3.1 +date: 2024-02-12T10:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.3.0...v1.3.1 diff --git a/changelog/wave/v1.3.2.mdx b/changelog/wave/v1.3.2.mdx new file mode 100644 index 000000000..6abfde397 --- /dev/null +++ b/changelog/wave/v1.3.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.3.2 +date: 2024-02-12T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.3.1...v1.3.2 diff --git a/changelog/wave/v1.3.3.mdx b/changelog/wave/v1.3.3.mdx new file mode 100644 index 000000000..cf00aaf98 --- /dev/null +++ b/changelog/wave/v1.3.3.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.3.3 +date: 2024-02-18 +tags: [wave] +--- + +## Feature updates and improvements + +- Added Document Wave configurations and Variables by @munishchouhan in https://github.com/seqeralabs/wave/pull/360 +- Added error message when spack object is null by @munishchouhan in https://github.com/seqeralabs/wave/pull/361 +- Cleanup formatting by @jason-seqera in https://github.com/seqeralabs/wave/pull/399 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.3.2...v1.3.3 diff --git a/changelog/wave/v1.4.0.mdx b/changelog/wave/v1.4.0.mdx new file mode 100644 index 000000000..b3a9949d1 --- /dev/null +++ b/changelog/wave/v1.4.0.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.4.0 +date: 2024-02-27 +tags: [wave] +--- + +## Feature updates and improvements + +- Added OffsetDateTime.now() as default value of ts in WaveContainerRecord when timestamp in SubmitContainerTokenRequest is null by @munishchouhan in https://github.com/seqeralabs/wave/pull/407 +- Add services to store and display Wave usage metrics by @munishchouhan in https://github.com/seqeralabs/wave/pull/393 +- Change fusionVersion Type to String by @munishchouhan in https://github.com/seqeralabs/wave/pull/411 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.3.3...v1.4.0 diff --git a/changelog/wave/v1.5.0.mdx b/changelog/wave/v1.5.0.mdx new file mode 100644 index 000000000..4bba7029b --- /dev/null +++ b/changelog/wave/v1.5.0.mdx @@ -0,0 +1,16 @@ +--- +title: Wave v1.5.0 +date: 2024-03-25T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Bumped actions/upload-artifact to v4 and fix tests by @munishchouhan in https://github.com/seqeralabs/wave/pull/417 +- Update aws sdk to version v2 by @munishchouhan in https://github.com/seqeralabs/wave/pull/415 +- Add documentation for Metrics API by @munishchouhan in https://github.com/seqeralabs/wave/pull/414 +- Add all values to entrypoint by @munishchouhan in https://github.com/seqeralabs/wave/pull/416 +- Add API and UI to evict a wave request from token cache by @munishchouhan in https://github.com/seqeralabs/wave/pull/410 +- Improved token cache eviction status design by @munishchouhan in https://github.com/seqeralabs/wave/pull/419 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.4.0...v1.5.0 diff --git a/changelog/wave/v1.5.1.mdx b/changelog/wave/v1.5.1.mdx new file mode 100644 index 000000000..e8a6fce00 --- /dev/null +++ b/changelog/wave/v1.5.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.5.1 +date: 2024-03-25T11:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.5.0...v1.5.1 diff --git a/changelog/wave/v1.5.2.mdx b/changelog/wave/v1.5.2.mdx new file mode 100644 index 000000000..dc80865e9 --- /dev/null +++ b/changelog/wave/v1.5.2.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.5.2 +date: 2024-03-25T12:00 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.5.1...v1.5.2 diff --git a/changelog/wave/v1.6.0.mdx b/changelog/wave/v1.6.0.mdx new file mode 100644 index 000000000..db25111d7 --- /dev/null +++ b/changelog/wave/v1.6.0.mdx @@ -0,0 +1,21 @@ +--- +title: Wave v1.6.0 +date: 2024-04-10 +tags: [wave] +--- + +## Feature updates and improvements + +- Refactor build id & status endpoint by @pditommaso in https://github.com/seqeralabs/wave/pull/421 +- Update platform api endpoint to api.cloud.seqera.io by @munishchouhan in https://github.com/seqeralabs/wave/pull/434 +- Fix RedisTestContainer flaky test by @munishchouhan in https://github.com/seqeralabs/wave/pull/436 +- Fix Build pod name by @munishchouhan in https://github.com/seqeralabs/wave/pull/438 +- Fix Containerfile encoding by @pditommaso in https://github.com/seqeralabs/wave/pull/441 +- Fix docker file alignment in container view by @munishchouhan in https://github.com/seqeralabs/wave/pull/442 +- Patch tower endpoints to new ones by @pditommaso in https://github.com/seqeralabs/wave/pull/440 +- Add v1alpha2 request endpoint by @pditommaso in https://github.com/seqeralabs/wave/pull/423 +- Add metrics service based on redis by @munishchouhan in https://github.com/seqeralabs/wave/pull/429 +- Document build status and examples for container endpoint by @munishchouhan in https://github.com/seqeralabs/wave/pull/447 +- Fix platform migration by @pditommaso in https://github.com/seqeralabs/wave/pull/444 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.5.2...v1.6.0 diff --git a/changelog/wave/v1.6.1.mdx b/changelog/wave/v1.6.1.mdx new file mode 100644 index 000000000..b95786f86 --- /dev/null +++ b/changelog/wave/v1.6.1.mdx @@ -0,0 +1,7 @@ +--- +title: Wave v1.6.1 +date: 2024-04-11 +tags: [wave] +--- + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.6.0...v1.6.1 diff --git a/changelog/wave/v1.6.2.mdx b/changelog/wave/v1.6.2.mdx new file mode 100644 index 000000000..beb82eb58 --- /dev/null +++ b/changelog/wave/v1.6.2.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.6.2 +date: 2024-04-12 +tags: [wave] +--- + +## Feature updates and improvements + +- Removce legacy surreal client by @pditommaso in [dad20d7](https://github.com/seqeralabs/wave/commit/dad20d704d0bc0bd3a5796efabd59e9ce0e5e3e2) +- Make createBuild record sync by @pditommaso in [76232d3](https://github.com/seqeralabs/wave/commit/76232d3654aea9e8a700d089ce6dc120f7424fd0) + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.6.1...v1.6.2 diff --git a/changelog/wave/v1.7.0.mdx b/changelog/wave/v1.7.0.mdx new file mode 100644 index 000000000..769ccfe78 --- /dev/null +++ b/changelog/wave/v1.7.0.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.7.0 +date: 2024-04-22 +tags: [wave] +--- + +## Feature updates and improvements + +- Improve build container naming strategy by @pditommaso in https://github.com/seqeralabs/wave/pull/460 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.0-B5...v1.7.0 diff --git a/changelog/wave/v1.7.1.mdx b/changelog/wave/v1.7.1.mdx new file mode 100644 index 000000000..12d6c63ca --- /dev/null +++ b/changelog/wave/v1.7.1.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.7.1 +date: 2024-04-23 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix redis flaky tests by @munishchouhan in https://github.com/seqeralabs/wave/pull/462 +- Add null check for container image name by @munishchouhan in https://github.com/seqeralabs/wave/pull/465 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.0...v1.7.1 diff --git a/changelog/wave/v1.7.2.mdx b/changelog/wave/v1.7.2.mdx new file mode 100644 index 000000000..671646e9e --- /dev/null +++ b/changelog/wave/v1.7.2.mdx @@ -0,0 +1,14 @@ +--- +title: Wave v1.7.2 +date: 2024-04-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Remove deprecated metrics v1alpha1 by @pditommaso in https://github.com/seqeralabs/wave/pull/467 +- Add document how metrics counter works by @munishchouhan in https://github.com/seqeralabs/wave/pull/470 +- Use IO executor consistently by @pditommaso in https://github.com/seqeralabs/wave/pull/471 +- Update metric service to get aggregated metrics by @munishchouhan in https://github.com/seqeralabs/wave/pull/472 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.1...v1.7.2 diff --git a/changelog/wave/v1.7.3.mdx b/changelog/wave/v1.7.3.mdx new file mode 100644 index 000000000..36f4cf0fe --- /dev/null +++ b/changelog/wave/v1.7.3.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.7.3 +date: 2024-04-30T10:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Describe use of sha256 hash with Wave by @jason-seqera in https://github.com/seqeralabs/wave/pull/448 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.2...v1.7.3 diff --git a/changelog/wave/v1.7.4.mdx b/changelog/wave/v1.7.4.mdx new file mode 100644 index 000000000..45dfd81f2 --- /dev/null +++ b/changelog/wave/v1.7.4.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.7.4 +date: 2024-04-30T12:00 +tags: [wave] +--- + +## Feature updates and improvements + +- Prevent use community registry w/o packages by by @pditommaso in [9eb1103](https://github.com/seqeralabs/wave/commit/9eb110317698951638bbaff80adfa0504aff5e48) + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.3...v1.7.4 diff --git a/changelog/wave/v1.7.5.mdx b/changelog/wave/v1.7.5.mdx new file mode 100644 index 000000000..ee2c28242 --- /dev/null +++ b/changelog/wave/v1.7.5.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.7.5 +date: 2024-05-02 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix "Error: EACCES: permission denied" in CI by @munishchouhan in https://github.com/seqeralabs/wave/pull/480 +- Fix CI errors by @munishchouhan in https://github.com/seqeralabs/wave/pull/481 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.4...v1.7.5 diff --git a/changelog/wave/v1.7.6.mdx b/changelog/wave/v1.7.6.mdx new file mode 100644 index 000000000..26a115b6f --- /dev/null +++ b/changelog/wave/v1.7.6.mdx @@ -0,0 +1,14 @@ +--- +title: Wave v1.7.6 +date: 2024-05-08 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix ci errors by @munishchouhan in https://github.com/seqeralabs/wave/pull/482 +- Fix aggregate metrics issue by @munishchouhan in https://github.com/seqeralabs/wave/pull/487 +- Fixes the Community repo name composition when namingStrategy is not specified by @pditommaso in https://github.com/seqeralabs/wave/pull/492 +- Fix the handling of pip packages with Conda by @pditommaso in https://github.com/seqeralabs/wave/pull/493 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.5...v1.7.6 diff --git a/changelog/wave/v1.7.7.mdx b/changelog/wave/v1.7.7.mdx new file mode 100644 index 000000000..09d972531 --- /dev/null +++ b/changelog/wave/v1.7.7.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.7.7 +date: 2024-05-11 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix legacy tower endpoint validation by @pditommaso in https://github.com/seqeralabs/wave/pull/495 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.6...v1.7.7 diff --git a/changelog/wave/v1.7.8.mdx b/changelog/wave/v1.7.8.mdx new file mode 100644 index 000000000..ff3e6d30c --- /dev/null +++ b/changelog/wave/v1.7.8.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.7.8 +date: 2024-05-15 +tags: [wave] +--- + +## Feature updates and improvements + +- Improve thread pool handling by @pditommaso in https://github.com/seqeralabs/wave/pull/494 +- Improve pairing record check by @pditommaso in https://github.com/seqeralabs/wave/pull/500 +- Prevent container freeze without custom repo by @pditommaso in https://github.com/seqeralabs/wave/pull/499 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.7...v1.7.8 diff --git a/changelog/wave/v1.7.9.mdx b/changelog/wave/v1.7.9.mdx new file mode 100644 index 000000000..39c71d433 --- /dev/null +++ b/changelog/wave/v1.7.9.mdx @@ -0,0 +1,15 @@ +--- +title: Wave v1.7.9 +date: 2024-05-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Fixed rate limit docs by @munishchouhan in https://github.com/seqeralabs/wave/pull/506 +- Removed unused imports by @munishchouhan in https://github.com/seqeralabs/wave/pull/510 +- Cleanup metrics docs by @jason-seqera in https://github.com/seqeralabs/wave/pull/508 +- Update API Documentation by @munishchouhan in https://github.com/seqeralabs/wave/pull/464 +- Improve JWT refresh handling by @pditommaso in https://github.com/seqeralabs/wave/pull/512 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.8...v1.7.9 diff --git a/changelog/wave/v1.8.0.mdx b/changelog/wave/v1.8.0.mdx new file mode 100644 index 000000000..fb6a5fb03 --- /dev/null +++ b/changelog/wave/v1.8.0.mdx @@ -0,0 +1,21 @@ +--- +title: Wave v1.8.0 +date: 2024-06-10 +tags: [wave] +--- + +## Feature updates and improvements + +- Add homebrew install doc by @munishchouhan in https://github.com/seqeralabs/wave/pull/514 +- Fix minor typos by @mribeirodantas in https://github.com/seqeralabs/wave/pull/515 +- Fix handling blob response headers by @pditommaso in https://github.com/seqeralabs/wave/pull/504 +- Add breakdown per org on stats metrics when a date is specified by @munishchouhan in https://github.com/seqeralabs/wave/pull/517 +- Fix metric key pattern variable name by @munishchouhan in https://github.com/seqeralabs/wave/pull/518 +- Implement cache store for build records by @pditommaso in https://github.com/seqeralabs/wave/pull/505 +- Replace kaniko with buildkit by @munishchouhan in https://github.com/seqeralabs/wave/pull/503 + +## New Contributors + +- @mribeirodantas made their first contribution in https://github.com/seqeralabs/wave/pull/515 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.7.9...v1.8.0 diff --git a/changelog/wave/v1.8.1.mdx b/changelog/wave/v1.8.1.mdx new file mode 100644 index 000000000..a8c2b6c8f --- /dev/null +++ b/changelog/wave/v1.8.1.mdx @@ -0,0 +1,13 @@ +--- +title: Wave v1.8.1 +date: 2024-06-13 +tags: [wave] +--- + +## Feature updates and improvements + +- Update metrics API documentation by @munishchouhan in https://github.com/seqeralabs/wave/pull/523 +- Fix image name strategy by @munishchouhan in https://github.com/seqeralabs/wave/pull/513 +- Fix digest warning by @pditommaso in https://github.com/seqeralabs/wave/pull/526 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.8.0...v1.8.1 diff --git a/changelog/wave/v1.8.2.mdx b/changelog/wave/v1.8.2.mdx new file mode 100644 index 000000000..d658e7034 --- /dev/null +++ b/changelog/wave/v1.8.2.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.8.2 +date: 2024-06-14 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix get image auth digest by @pditommaso in https://github.com/seqeralabs/wave/pull/530 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.8.1...v1.8.2 diff --git a/changelog/wave/v1.8.3.mdx b/changelog/wave/v1.8.3.mdx new file mode 100644 index 000000000..7051b797d --- /dev/null +++ b/changelog/wave/v1.8.3.mdx @@ -0,0 +1,12 @@ +--- +title: Wave v1.8.3 +date: 2024-06-29 +tags: [wave] +--- + +## Feature updates and improvements + +- Fix client cache deadlock by @pditommaso in https://github.com/seqeralabs/wave/pull/547 +- Add cache record-stats by @pditommaso in https://github.com/seqeralabs/wave/pull/534 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.8.2...v1.8.3 diff --git a/changelog/wave/v1.9.0.mdx b/changelog/wave/v1.9.0.mdx new file mode 100644 index 000000000..e253d1691 --- /dev/null +++ b/changelog/wave/v1.9.0.mdx @@ -0,0 +1,30 @@ +--- +title: Wave v1.9.0 +date: 2024-07-10 +tags: [wave] +--- + +## Feature updates and improvements + +- Added troubleshoot.mdx by @munishchouhan in https://github.com/seqeralabs/wave/pull/529 +- Bump buildkit to 0.14.0 by @munishchouhan in https://github.com/seqeralabs/wave/pull/528 +- Added record-stats by @munishchouhan in https://github.com/seqeralabs/wave/pull/534 +- Fix client cache deadlock by @pditommaso in https://github.com/seqeralabs/wave/pull/547 +- Bump buildkit 0.14.1 by @pditommaso in https://github.com/seqeralabs/wave/pull/548 +- Fix failing test by @munishchouhan in https://github.com/seqeralabs/wave/pull/539 +- Update mertics response by @munishchouhan in https://github.com/seqeralabs/wave/pull/536 +- refactored metrics 2 by @munishchouhan in https://github.com/seqeralabs/wave/pull/549 +- Add Typespec API definitions by @munishchouhan in https://github.com/seqeralabs/wave/pull/537 +- Check and delete corrupted blobs in cache by @munishchouhan in https://github.com/seqeralabs/wave/pull/533 +- Fix multiple s3clients in wave by @munishchouhan in https://github.com/seqeralabs/wave/pull/554 +- Fix null storage bucket error in build logs by @munishchouhan in https://github.com/seqeralabs/wave/pull/555 +- Deprecate the support for Spack and remove the support for it in the codebase by @munishchouhan in https://github.com/seqeralabs/wave/pull/550 +- Remove buildlogs aws config to not initialize AwsS3Operations by @munishchouhan in https://github.com/seqeralabs/wave/pull/558 +- Update Wave docs to include licensing note by @justinegeffen in https://github.com/seqeralabs/wave/pull/557 +- Improve container credentials retrieval using workflow compute environment by @munishchouhan in https://github.com/seqeralabs/wave/pull/303 + +## New Contributors + +- @justinegeffen made their first contribution in https://github.com/seqeralabs/wave/pull/557 + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.8.2...v1.9.0 diff --git a/changelog/wave/v1.9.1.mdx b/changelog/wave/v1.9.1.mdx new file mode 100644 index 000000000..7a5b4ee4d --- /dev/null +++ b/changelog/wave/v1.9.1.mdx @@ -0,0 +1,11 @@ +--- +title: Wave v1.9.1 +date: 2024-07-16 +tags: [wave] +--- + +## Feature updates and improvements + +- Prevent hard error when launch credentials cannot be accessed by @pditommaso in [a318a855](https://github.com/seqeralabs/wave/commit/a318a855282005eb3d7b5bfa21a3c7865cc947fb) + +**Full Changelog**: https://github.com/seqeralabs/wave/compare/v1.9.0...v1.9.1 diff --git a/changelog/wave_1.12.3.mdx b/changelog/wave_1.12.3.mdx deleted file mode 100644 index b1ac73f80..000000000 --- a/changelog/wave_1.12.3.mdx +++ /dev/null @@ -1,10 +0,0 @@ ---- -title: Wave v1.12.3 -date: 2024-09-22 -tags: [wave] ---- - -### Bug fixes - -- Fix build status completion of submit exception. -- Fix singularity build mounts. \ No newline at end of file diff --git a/changelog/wave_1.12.4.mdx b/changelog/wave_1.12.4.mdx deleted file mode 100644 index 89fb68125..000000000 --- a/changelog/wave_1.12.4.mdx +++ /dev/null @@ -1,9 +0,0 @@ ---- -title: Wave v1.12.4 -date: 2024-09-26 -tags: [wave] ---- - -### Bug fixes - -- Fix build succeeded and status response. \ No newline at end of file diff --git a/docusaurus.config.js b/docusaurus.config.js index 6fd8b89ff..6347438a0 100644 --- a/docusaurus.config.js +++ b/docusaurus.config.js @@ -32,6 +32,9 @@ export default async function createConfigAsync() { locales: ["en"], }, + // .md files should be MD and not MDX + markdown: {format: 'detect'}, + future: { experimental_faster: false, },