NOTICE: FULL O2 Cluster Outage, January 3 - January 10th

O2 will be completely offline for a planned HMS IT data center relocation from Friday, Jan 3, 6:00 PM, through Friday, Jan 10

  • on Jan 3 (5:30-6:00 PM): O2 login access will be turned off.
  • on Jan 3 (6:00 PM): O2 systems will start being powered off.

This project will relocate existing services, consolidate servers, reduce power consumption, and decommission outdated hardware to improve efficiency, enhance resiliency, and lower costs.

Specifically:

  • The O2 Cluster will be completely offline, including O2 Portal.
  • All data on O2 will be inaccessible.
  • Any jobs still pending when the outage begins will need to be resubmitted after O2 is back online.
  • Websites on O2 will be completely offline, including all web content.

More details at: https://harvardmed.atlassian.net/l/cp/1BVpyGqm & https://it.hms.harvard.edu/news/upcoming-data-center-relocation

Fastx, Bowtie2 and MACS2 for ChipSeq

Start an interactive job, with a walltime of 2 hours, 2000MB of memory. 

srun --pty -p interactive -t 0-02:0:0 --mem 2000MB -n 1 /bin/bash

Create a working directory on scratch and change into the newly-created directory. For example, for user abc123, the working directory will be

mkdir /n/scratch/users/a/abc123/chipSeq cd /n/scratch/users/a/abc123/chipSeq

Build a barcode file for demultiplexing library: 

The first column give sample name. 1Tr for sample 1 treatment, 1Co for sample 1 control.

nano barcode.txt 1Tr ATCACG 2Tr CGATGT 3Tr TTAGGC 4Tr TGACCA 5Tr ACAGTG 1Co TAGCTT 2Co GGCTAC 3Co CTTGTA 4Co ATATAGGA 5Co AACCGTGT

Load rcbio module and copy the example bowtie2 and macs2 bash script:



Now you can modify the command options as needed. To edit the script:



To test the pipeline run the following command. Jobs will not be submitted to the scheduler.

To run the fastxBowtie2 pipeline:



After fastxBowtie2 workflow finishes, dry run macs2 to make sure it is fine: 

To run the macs2 pipeline:

To understand how 'runAsPipeline' works, how to check output, how to re-run the pipeline, please visit: Run Bash Script As Slurm Pipeline

Now you are ready to run an rcbio workflow

To instead run the workflow on your own data, transfer the sample sheet to your local machine following this wiki page and modify the sample sheet. Then you can transfer it back to O2 under your account, then go to the build folder structure step.