Jasmin on Centre for Environmental Data Analysis

JASMIN Notebook Service Environment Updates

Mon, 02 Feb 2026 11:30:00 +0000

Dear JASMIN Users,

We are making some changes to the software environments provided by the JASMIN notebook service, in order to make it more compatible with the environment on the rest of JASMIN. The environments provided on the notebook service will now be identical to that provided on the sci machines and LOTUS.

Support over the Christmas period and JASMIN updates

Thu, 11 Dec 2025 09:00:00 +0000

Dear JASMIN and CEDA users,

This message includes information about JASMIN and CEDA support arrangements over the Christmas period and important updates on JASMIN services:

Introduction to Scientific Computing Course 2025

Mon, 17 Nov 2025 00:00:00 +0000

Dates

Course	Date	Location
Introduction to the bash shell (Unix/Linux)	Tuesday 4th November, 09:30 - 16:00	Online
Introduction to Python programming	Monday 17th November, 10:00 - Wednesday 19th November, 12:00	Leeds
Python programming – working with data & Introduction to Git/GitHub	Wednesday 19th November, 13:00 - Friday 21st November, 16:00	Leeds

Find out more information and apply here!

The Introduction to Scientific Computing (ISC) course covers the skills needed to start using the Linux Shell and Python in environmental science research. The course is designed for complete beginners as well as those with a little experience who wish to further their knowledge. Some prerequisite Python knowledge is necessary to study the “Python Programming – Working with Data” module. On the final day of the “Working with Data” module there will be two parallel sessions focussing, respectively, on the use of atmospheric science data and earth observation data. Students may join either session depending on their own learning needs and preferences.

JASMIN Updates October 2025

Tue, 21 Oct 2025 15:00:00 +0000

Please note the following updates for your attention:

Reminder of scheduled maintenance day, Tuesday 4 November 2025
New scratch volumes, retirement of old
XFC service changes
Storage migration progress

Reminder of scheduled maintenance day, Tuesday 4 November

As previously announced via the status page, a regular maintenance day is scheduled for Tuesday 4th November. This potentially affects all JASMIN and CEDA services.

Register for the introduction to Scientific Computing Course now!

Tue, 14 Oct 2025 16:30:00 +0000

Want to study scientific computing? From the Linux Shell to Python, our Introduction to Scientific Computing course will prepare you to use computing in environmental science research.

JASMIN User Conference 2025

Wed, 01 Oct 2025 00:00:00 +0000

We have reluctantly taken the decision NOT to go ahead with the current plan for the JASMIN User Conference scheduled for 1-2 October 2025. Low registration numbers meant that an in-person event was not viable in its planned format.

JASMIN User Conference - important information

Wed, 10 Sep 2025 09:00:00 +0000

August Bank Holiday Updates - Monday 25th & Tuesday 26th August 2025

Thu, 21 Aug 2025 12:30:00 +0000

Dear all,

Services will be unsupported on Monday 25th and Tuesday 26th August due to the bank holiday on Monday 25th and the RAL site holiday on Tuesday 26th. Staff leave during the following week will also mean that responses to queries may take longer than usual.

JASMIN updates for July 2025

Mon, 21 Jul 2025 10:00:00 +0000

Please note the following updates/reminders from the JASMIN team, for your attention:

Scheduled maintenance Tuesday 29 July - next week
New releases of JASPY and JASR
Migration of group workspaces - now underway
User Conference 1 & 2 October - save the dates!
Recent storage issues -how you can help

Scheduled maintenance Tuesday 29 July

REMINDER: Tuesday 29 July will be a scheduled maintenance day for JASMIN. Previous announcement.

New releases of Jaspy and Jasr

Wed, 16 Jul 2025 10:00:00 +0000

New releases of Jaspy and JasR are now available on JASMIN, on the sci machines and LOTUS. They can be loaded using module load jaspy/3.12/v20250704 or module load jasr/4.4/v20250704 as appropriate.

JASMIN Storage migration

Fri, 30 May 2025 14:30:00 +0000

We are pleased to announce that new storage hardware is now in place to replace older capacity on JASMIN, so a major storage migration is about to start.

JASMIN User Conference 2025 - save the dates

Thu, 24 Apr 2025 17:00:00 +0000

IMPORTANT - Please note change of dates

We will be hosting the next JASMIN conference at RAL on the Harwell Campus in Oxfordshire on Wednesday 1st and Thursday 2nd October 2025.

Easter updates for CEDA and JASMIN users

Mon, 14 Apr 2025 16:00:00 +0000

Please note the following updates for your attention:

CEDA and JASMIN support over the Easter period
Scheduled maintenance affecting SSD storage Tues 22 April
JASMIN regular scheduled maintenance Tues 29 April
Changes to scheduler policies for standard and highres partitions

Over the Easter period, CEDA and JASMIN services will be running at risk. Due to public holidays, our helpdesks will be closed at the end of working hours on Thursday 17th April until the morning of Tuesday 22nd April. Staff leave during the school holiday period also affects our availability at this time.

JASMIN Webinar - March 2025

Wed, 26 Mar 2025 00:00:00 +0000

On Wednesday 26th March, 10.00 - 12.00 GMT The CEDA//JASMIN team will be presenting a webinar to provide an update and describe new services available on JASMIN. Following the presentations there will be a Q&A session with the speakers and other members of the JASMIN team to give you an opportunity to ask questions.

JASMIN: further updates about new cluster and notebooks service

Fri, 07 Feb 2025 14:00:00 +0000

In this update:

Further news and important dates regarding migration to the new cluster, LOTUS2
NEW: JASMIN notebooks service now supports GPUs

Please note the following updates as part of our current migration , which includes the retirement of the old CentOS7 cluster, LOTUS, with the new Rocky 9 cluster, LOTUS2:

Retirement of authenticated FTP service

Thu, 06 Feb 2025 12:30:00 +0000

After a review of our FTP service following a security incident at the end of 2024 we have decided that we will no longer support authenticated FTP access to restricted data in the CEDA Archive via ftp.ceda.ac.uk.

JASMIN updates: new cluster, scratch quotas, anaconda defaults removal

Tue, 28 Jan 2025 15:00:00 +0000

In this update:

New LOTUS2 cluster now available - please use it!
Scratch quotas now in force - please clean up!
Anaconda defaults removal - please check if this affects you!
Reboots and changes to physical sci servers

Details:

JASMIN updates: new cluster and maintenance day

Wed, 15 Jan 2025 17:00:00 +0000

Important updates regarding LOTUS cluster and upcoming maintenance on JASMIN

In this update:

Support over the Christmas period and JASMIN updates

Thu, 12 Dec 2024 09:00:00 +0000

Dear JASMIN and CEDA users,

This message includes information about JASMIN and CEDA support arrangements over the Christmas period and important updates on JASMIN services:

JASMIN Training Workshop

Thu, 28 Nov 2024 00:00:00 +0000

On Thursday 28th November 09:00-15:30 BST We will be running a JASMIN training workshop, aimed at new and intermediate users.

Upcoming JASMIN host retirements

Thu, 21 Nov 2024 15:00:00 +0000

Please read - affects ALL users

Upcoming host retirements
Update on SOF storage issue

Upcoming host retirements

As part of our current migration to the Rocky 9 operating system , the following timetable of host retirements is planned.

Introduction to Sceintific Computing Course - 2024

Mon, 04 Nov 2024 00:00:00 +0000

Find out more and apply here!

Join our JASMIN Training Workshop!

Mon, 28 Oct 2024 17:30:00 +0000

Dear Users,

We will be running a JASMIN training workshop, aimed at new and intermediate users, on Thursday 28th November 09:00-15:30 BST.

Changes to JASMIN cron, transfer and NX services

Thu, 24 Oct 2024 09:30:00 +0000

Please note the following JASMIN announcements for your attention:

Changes to cron (and all transfers using xfer3)
Changes to NoMachine NX service (nx-login servers)

1. Changes to cron and transfer services

The old servers enabling task scheduling with cron, namely cron.jasmin.ac.uk (aka cron1.ceda.ac.uk) and xfer3.jasmin.ac.uk, are due to be retired, as replacements are already available as part of our migration to the Rocky Linux 9 operating system.

Reminder of upcoming JASMIN changes and maintenance periods

Fri, 04 Oct 2024 15:00:00 +0000

Dear users

Please note the following JASMIN announcements for your attention:

New services now available: please start using them!
JASMIN maintenance: electrical testing, 8-10 October (all systems at risk)
JASMIN Scheduled maintenance day, Tuesday 15 October (all systems at risk)

1. New services now available

General

JASMIN Help Documentation has now been updated to reflect the new Rocky 9 servers, so users are now asked to start using these (login, sci, xfer, hpxfer, etc) wherever possible. Please update your local configuration if you have stored the names of older servers. Older servers will start to be withdrawn over the next weeks, but will be announced in advance.

New services and reminder of software changes on JASMIN

Wed, 04 Sep 2024 11:00:00 +0000

Dear users

New services now available

Details of the new Rocky 9 environment are now available here .

Important software changes on JASMIN Autumn 2024

Thu, 29 Aug 2024 15:30:00 +0000

Dear users

You will already be aware of the migration already underway from the CentOS7 to Rocky Linux 9 operating system. Further details of that new environment are now available below:

August bank holiday weekend arrangements - Monday 26th and Tuesday 27th August 2024

Thu, 22 Aug 2024 12:00:00 +0000

Dear All,

Services will be unsupported on Monday 26th and Tuesday 27th August due to the bank holiday on Monday 26th and RAL site holiday on Tuesday 27th. Staff leave during the remainder of the week will also mean that responses to queries may take longer than usual.

JDMA users - update your client

Mon, 12 Aug 2024 09:00:00 +0000

Last week, we announced that the Elastic Tape (ET) and JDMA services had resumed after an operating system upgrade.

Some additional points to note:

Software and operating system changes - update 1

Wed, 19 Jun 2024 17:30:00 +0000

This is the first update about our progress migrating operating systems on JASMIN from CentOS7 to Rocky Linux 9 as announced previously here. Details of the migration in particular software packages can be found here .

Quota issue with SOF storage volumes

Fri, 14 Jun 2024 14:30:00 +0000

Dear users,

We are aware of an issue with volume quotas in the SOF storage system, affecting GWS volumes /gws/nopw/j04/* and CEDA Archive volumes. It appears that the system is permitting writes beyond the initial volume quota, then artificially increasing the quota reported by “df -H” up to a point where writes are no longer possible. The volume quota is initially set when a volume is created; this is recorded in the JASMIN Projects Portal and available to view in the GWS Dashboard at https://mon.jasmin.ac.uk (accounts portal credentials required). This is the true volume quota: it appears that the value reported by df -H has become unreliable in these cases. The suggested course of action for GWS managers is as follows:

GWS public web access server update

Tue, 28 May 2024 14:30:00 +0000

On Tuesday 4th June the GWS public web access server ( https://gws-access.jasmin.ac.uk ) will be moved to a new platform.

Major investment triples capacity for analysing environmental data

Wed, 08 May 2024 10:30:00 +0000

Scientists will soon have access to triple the processing power for analysing environmental data. A £5.7 million investment for expanding the parallel compute cluster, called LOTUS , on JASMIN has been secured. The improved infrastructure allows much greater volume of parallel computing tasks - where multiple streams of data analysis tasks are undertaken at the same time - whilst reducing the time that users have to wait for their analysis to complete. Capacity will be tripled and will be available to users from Summer 2024.

Software and operating system updates coming soon to JASMIN

Fri, 03 May 2024 09:30:00 +0000

Moving to Rocky Linux 9

For the past few weeks and months we have been preparing for a change of operating system version on JASMIN. We are now sharing our plans and progress with you, so that you are aware of the remaining changes about to happen. We can then keep you up to date with further progress as the migration gets underway.

Updates to jaspy and jasr software environments

Wed, 03 Apr 2024 13:30:00 +0000

The following software environments jaspy and jasr will have new default versions on Tuesday 16th April (JASMIN patch day):

jaspy: Python, and other tools and libraries.
- based on Python 3.11, release notes at https://github.com/cedadev/ceda-jaspy-envs/releases/tag/jaspy3.11_r20240302
jasr: R tools and libraries.
- based on R 4.3, release notes at https://github.com/cedadev/ceda-jaspy-envs/releases/tag/jasr4.3_r20240320

The new version of Jaspy (jaspy/3.11/r20240302) and Jasr (jasr/4.3/r20240320) will become the default version that is obtained when using module load jaspy or module load jasr without an explicit version number.

Easter updates for CEDA and JASMIN users

Wed, 27 Mar 2024 16:00:00 +0000

Please note the following updates for your attention:

CEDA and JASMIN support over the Easter period
JASMIN regular scheduled maintenance Tuesday 16th April 2024
Updated JASMIN dashboard now available
Information for JASMIN cloud tenancy managers

As usual over the Easter period, CEDA and JASMIN services will be running at risk. Our helpdesks will be closed out of working hours and staff leave during the school holidays also means that staff levels after the Easter weekend may be reduced.

JASMIN storage issues having wider effects

Thu, 21 Mar 2024 09:30:00 +0000

An internal performance issue with SOF storage is causing many machines to be unresponsive. The storage vendor is engaged with the system team’s investigation.

JASMIN Webinars available to watch now!

Wed, 20 Mar 2024 12:30:00 +0000

The recording from the latest JASMIN seminar series is available to watch on Yotube.

You can click here to watch the JASMIN talks given from the UK Centre for Ecology and Hydrology

All of the previous JASMIN Seminars have also been recorded and the slides saved. You can check out the other seminars on our event page here.

JASMIN issue with home directories and related storage

Wed, 13 Mar 2024 15:00:00 +0000

An issue with the storage used for the following services is causing degraded performance and is under investigation with the vendor:

JASMIN storage issues resolved

Tue, 27 Feb 2024 14:30:00 +0000

Dear users,

The storage and performance issues from the past few days should now be resolved.

If you have any further issues, please contact the helpdesk.

JASMIN storage issues affecting JASMIN and CEDA services

Tue, 27 Feb 2024 10:45:00 +0000

The current issue with JASMIN SOF storage continues to affect many JASMIN and CEDA services.

JASMIN Cloud Survey Reminder

Tue, 13 Feb 2024 12:15:00 +0000

Dear Users,

I would like to remind you that the survey on the JASMIN Cloud is still open. We have decided to close the survey on 28th Feb. It would be incredibly helpful to get the community’s input on the future of the JASMIN Cloud, so please consider spending the time to fill in the survey - it should take less than 10 mins to complete.

JASMIN User Seminar Series restarting 6th February - 1pm

Tue, 30 Jan 2024 12:15:00 +0000

Dear JASMIN users,

We are hosting a webinar on Tuesday 6th of February at 1pm.

It is part of the JASMIN seminar user series aiming to encourage knowledge sharing and best practices between JASMIN users - whilst showcasing the types of science enabled by JASMIN. The format is an online presentation from two JASMIN users for 20 minutes, followed by a QA session.

JASMIN Cloud Survey and Announcements

Mon, 29 Jan 2024 15:00:00 +0000

Dear Users,

We have a couple of cloud related announcements to share with the JASMIN community:

JASMIN Cloud Survey
Deprecation of CentOS 7 cloud images
Upcoming migration of the Cloud Portal to Azimuth

JASMIN Cloud Survey

We have recently been informed that our cloud platform VMWare Integrated OpenStack (VIO) is being discontinued. This presents us with an opportunity to make decisions on the direction which we want to take the JASMIN Cloud. The timescale for this is by mid 2025.

Reminder - GWS managers survey & webinar on 8th Feb

Mon, 29 Jan 2024 09:15:00 +0000

To: all JASMIN Group Workspace Managers

(please ignore if you are not involved in managing a GWS)

Reminder to GWS Managers: Please take a few minutes to complete our survey of Group Workspaces on JASMIN.

Latest JASMIN Updates

Fri, 26 Jan 2024 09:15:00 +0000

Dear Users,

We have some exciting JASMIN-related updates to share with you:

JASMIN storage issues - resolved

Mon, 22 Jan 2024 09:15:00 +0000

Issues now resolved, please report any further problems.

Further problems occurred over the weekend with JASMIN’s SOF storage, used for /gws/nopw/j04/* group workspaces and the CEDA Archive. With LOTUS batch cluster jobs failing for this reason, hosts have been removed from the cluster for the time being.

JASMIN updates

Wed, 03 Jan 2024 14:30:00 +0000

We wish a happy new year to all our users.

Please note the following updates for your attention:

LOTUS throughput/capacity is currently slightly reduced while network switch maintenance is carried out. By a process of gradual rack-draining, compute nodes in each rack will be in maint state when viewed in SLURM node information e.g. sinfo

JASMIN supports hackathon exploring ocean model data

Fri, 22 Dec 2023 09:00:00 +0000

JASMIN supported over 40 hackathon attendees to help improve their data analysis skills with high-resolution ocean data. The hackathon made use of the JASMIN notebook service, group workspace storage and processing simulations on the LOTUS batch processing cluster.

The EERIE project is developing improved Earth system models, harnessing Europe’s pre-exascale computers and considering European ocean mesoscale eddies in preparation for the next Intergovernmental Panel on Climate Change report. The project’s first General Assembly, held in Germany, saw 43 project members from 15 different project partners attend an extra two days for the project’s first hackathon. The aim of the hackathon was for participants to get to know each other while looking at some of the initial EERIE high-resolution eddy-resolving simulations and to gain experience using some relevant software tools.

GWS managers - please complete our survey

Tue, 19 Dec 2023 11:15:00 +0000

GWS Managers: Please take a few minutes to complete our survey of Group Workspaces on JASMIN.

We are initiating this survey to examine the utilization of JASMIN group workspaces (GWSs). Storage is an expensive resource at the scale used within JASMIN and consumes significant energy. Your involvement is pivotal in helping us to understand how it is currently being used and how that could be improved. As a GWS manager you may be managing more than one GWS. In such a case please complete a separate survey for each GWS that you are responsible for. Conversely, if several of you are responsible for one workspace, please coordinate with each other to submit one response per workspace.

JASMIN Support over the Christmas period and updates

Wed, 13 Dec 2023 09:00:00 +0000

Dear JASMIN users,

This message includes information about the JASMIN support over the Christmas period and important updates on JASMIN services:

JASMIN Accounts Portal Downtime 14/12/23

Tue, 12 Dec 2023 09:00:00 +0000

Dear Users,

The JASMIN accounts portal will be unavailable for a short period this Thursday afternoon (14/12/23), and should be considered ‘at risk’ from 14:00 until the end of the day.

Changes to Globus on JASMIN

Wed, 06 Dec 2023 10:00:00 +0000

As announced recently, the current Globus endpoint on JASMIN is changing, and the old one will cease operating soon. The final day of operation for that endpoint is now confirmed as 18 December 2023.

Join our Communicating Climate Uncertainty Workshop on November 30th!

Tue, 28 Nov 2023 10:00:00 +0000

You are invited to a workshop on Uncertainty, delving into the crucial dialogue surrounding how users and providers of climate information navigate uncertainties.

Updates to software environments Jaspy and Jasr

Fri, 24 Nov 2023 10:00:00 +0000

The following software environments Jaspy and Jasr will have new default versions at 9:00 am on Wednesday 13th December 2023:

CEDA / JASMIN latest improvements

Thu, 23 Nov 2023 10:00:00 +0000

During the recent CEDA/JASMIN downtime we took the opportunity to make a range of changes, mostly behind the scenes, to make things more resilient and roll out a few enhancements. We’ve rounded these up here to share with our communities, to show how we made the best of the inevitable disruption to make improvements which benefit our user communities and ourselves in our day-to-day operations.

JASMIN power maintenance complete

Mon, 06 Nov 2023 10:00:00 +0000

All systems are now reported to be operating normally, so JASMIN and CEDA services can be considered back to normal and the recent power maintenance work considered complete.Any problems should now be reported to the relevant helpdesk (support@ceda.ac.uk for CEDA Archive services, support@jasmin.ac.uk for JASMIN services).

JASMIN Conference 2023

Wed, 01 Nov 2023 00:00:00 +0000

We will be hosting the next JASMIN conference at our host institute on the Harwell Campus in Oxfordshire. It will occur over two half days on the afternoon of Wednesday 1 and the morning of Thursday 2 November 2023.

JASMIN Update - partial return to service

Tue, 31 Oct 2023 08:30:00 +0000

Most subsystems are now back up with the exception of SLURM (the scheduler used for LOTUS and ORCHID clusters) and Object Storage. Login, (most) sci and xfer servers are accessible again, but any services reliant on LOTUS, Object Storage (e.g some web-based services) are not yet available. Please await further updates for full availability.

Updates on JASMIN shutdown

Tue, 31 Oct 2023 08:30:00 +0000

The electrical maintenance work over the weekend was completed successfully but JASMIN services are not yet available to users.

The infrastructure team is now working through the carefully-planned sequence of restarting and checking subsystems before making the services that depend on them, available again.

REMINDER JASMIN power maintenance Autumn 2023

Thu, 19 Oct 2023 14:00:00 +0000

Dear Users,

As per our previous announcements, essential work will be taking place this Autumn in the data centre (machine room) where JASMIN is hosted to carry out safety checks and 5-yearly recertification of power supply equipment.

JASMIN2023 user conference call for registration (REMINDER)

Tue, 17 Oct 2023 09:09:55 +0000

Dear JASMIN user,

As previously announced, we will be hosting the next JASMIN conference at our host institution, RAL, on the Harwell Campus in Oxfordshire. It will occur over two half days on the afternoon of Wednesday 1st November and the morning of Thursday 2nd of November 2023.

JASMIN Network Issues

Wed, 11 Oct 2023 07:34:44 +0000

Part of the JASMIN network suffered a failure yesterday evening and the team is currently working to resolve this. As a result, many JASMIN and CEDA services are currently unavailable.

Minor power issue affected some LOTUS jobs.

Tue, 03 Oct 2023 08:26:36 +0000

Dear Users

A minor power issue yesterday evening resulted in a number of LOTUS hosts rebooting. This will have affected any jobs running on those hosts. The hosts have now been returned to the queues.

REMINDER Advance notice of JASMIN power maintenance Autumn 2023

Fri, 08 Sep 2023 09:35:53 +0000

Dear Users,

As per our previous announcement in July, essential work will be taking place this Autumn in the data centre (machine room) where JASMIN is hosted to carry out safety checks and 5-yearly recertification of power supply equipment.

Issue with CEDA and JASMIN services - update

Wed, 30 Aug 2023 08:58:56 +0000

A connectivity issue has affected many CEDA and JASMIN services over the past 24 hrs. While affected services should now be available to users again, the issue has so far been attributed to a faulty network switch. A temporary fix is in place but until the faulty switch can be removed/replaced (timescale TBC), services should be considered “at risk”.
With apologies for any inconvenience.
JASMIN Team

Sustainable computing the UK’s journey to net zero digital research infrastructure by 2040

Fri, 04 Aug 2023 08:29:06 +0000

Leading UK data and computing experts have developed a toolkit and roadmap to get the UK’s digital research infrastructure sector to net zero.

Advance notice of JASMIN power maintenance Autumn 2023

Tue, 25 Jul 2023 14:49:36 +0000

Dear Users,

Please be advised that at some point between October and the end of the year, work will take place in the data centre (machine room) where JASMIN is hosted to carry out safety checks and 5-yearly recertification of power supply equipment.

RESOLVED - Issue with JASMIN GridFTP and Globus transfers

Mon, 24 Jul 2023 16:00:14 +0000

Dear Users

The earlier issue with GridFTP and Globus transfers to/from JASMIN has now been resolved.
Apologies for any inconvenience.

FAAM Airborne Laboratory data use survey

Fri, 21 Jul 2023 11:10:51 +0000

The FAAM Airborne Laboratory collects atmospheric data all over the world. From air quality, cloud formation, and weather processes, to greenhouse gas emissions from human activities and atmospheric composition, the FAAM Airborne Laboratory’s specially adapted research aircraft enables researchers to understand our changing environment. Over 1300 flights have collected a wealth of data from across the world.

Final Reminder - JASMIN maintenance day Tomorrow, Tuesday 11th July 2023

Mon, 10 Jul 2023 10:19:42 +0000

Dear JASMIN user,

This is the final reminder to please note the upcoming maintenance day Tomorrow, Tuesday 11th July. The following system work/enhancements are also planned for that date in order to minimise disruption:

Interruption to tape services for security maintenance

Fri, 30 Jun 2023 14:59:09 +0000

Further to our earlier announcement, tape services will need a separate interruption to apply security updates. Tape services will not be available between midday on Monday 3rd July until the work has completed, hopefully later on Tuesday 4th July.
This affects Elastic Tape, JDMA and Near-Line Archive services.

JASMIN login server login2 currently unavailable - Update This is now resolved

Tue, 20 Jun 2023 11:36:20 +0000

The issue with server login2 is now resolved and it should be available again.
Apologies for any inconvenience.
JASMIN Team

JASMIN updates Scheduled maintenance 11 July and other items

Mon, 12 Jun 2023 08:19:54 +0000

Dear users

Please note the following items for your attention:

JASMIN Regular scheduled maintenance day: 11 July 2023
New NX server available
Reboot of gws-access service Tuesday 13th June 08:30 & future changes to service.

Details:

Final Reminder NVIDIA HPC, AI and Data Science – making the most of your GPUs

Mon, 05 Jun 2023 08:33:27 +0000

Dear JASMIN user,

We will be hosting a webinar on Thursday 8th of June 2023 at 2pm about “NVIDIA HPC, AI and Data Science – making the most of your GPUs: Best Practices, Tools and Resources for Researchers”. This webinar will look at the best practices, tools and frameworks available which can help researchers quickly utilise the full abilities of the GPU hardware, even if they are GPU novices.

Update JASMIN GWS IO Errors

Thu, 01 Jun 2023 14:35:25 +0000

Dear JASMIN Users

We now believe that the issues affecting the storage for the GWS and CEDA Archive are resolved. Please let us know if you continue to have issues with IO Errors on the storage

JASMIN GWS IO Errors

Thu, 01 Jun 2023 08:46:15 +0000

Dear JASMIN Users

We are currently experiencing errors affecting the GWSs with the paths /gws/nopw/j04/ which are showing as IOErrors. We are in discussions with the vendor to get this fixed as soon as possible.

PFS storage affecting LOTUS

Thu, 11 May 2023 12:43:09 +0000

Dear Jasmin user,

The issue with PFS storage reported earlier is also affecting the batch cluster LOTUS. Batch jobs are timing out and many compute nodes going into a drain state. Please note that we are going to have to stop new LOTUS jobs running temporarily.

JASMIN updates nx-login machines reboot and tape services status

Tue, 02 May 2023 09:34:15 +0000

Please note the following JASMIN service updates for your attention:

nx-login service update

The servers nx-login[123].jasmin.ac.uk will be rebooted tomorrow Wed 3 May between 08:30 - 09:30 to apply new licenses. This will result in the interruption to desktop sessions, so please log out of your NX desktop session by the end of today to avoid disruption.

Near-line archive (NLA) unavailable from 27th April.

Thu, 27 Apr 2023 14:26:09 +0000

Dear Users

Due to problems arising from the JASMIN maintenance day on Tuesday 25th April, the Near-line Archive (NLA) remains unavailable. We are working hard to remedy this, but it is likely that the NLA will not be available until after the bank holiday weekend, 2nd May at the earliest.

JASMIN Accounts Portal - Email Delivery Problems

Wed, 26 Apr 2023 09:06:24 +0000

Dear JASMIN Users

The JASMIN accounts portal is currently having trouble delivering emails to users.

This means that login verification codes from the accounts portal are not being sent at the moment.

Vacancy Principal Project/Programme Manager

Mon, 24 Apr 2023 11:00:18 +0000

We have an exciting new vacancy for a Principal Project/Programme Manager within our CEDA team.

You will be responsible for effective leadership, management, delivery, and co-ordination of programmes and projects across CEDA. This includes oversight for major grants from our funders; management of complex software development projects involving multiple partners and stakeholders; project management for ongoing investment of hardware, software and services for the JASMIN computer facility and a portfolio of projects providing data science support, training and the development of new and innovative software and services for CEDA.

Change in email delivery from the JASMIN Accounts Portal

Thu, 30 Mar 2023 11:21:38 +0000

Dear Users,

The email address from which the JASMIN accounts portal sends notifications to users, such as service expiry reminders, password resets and one-time passwords is changing from no-reply@accounts.jasmin.ac.uk to noreply@jasmin.ac.uk*.*

Reminder JASMIN mini-patch day Tomorrow - Tuesday 21st March 2023

Mon, 20 Mar 2023 12:17:22 +0000

Dear JASMIN user,

Please note the upcoming “mini” maintenance day on Tuesday 21st March. The following system work/enhancements are also planned for that date in order to minimise disruption:

JASMIN Storage Issues affecting SOF volumes

Wed, 01 Mar 2023 09:34:28 +0000

Users may currently be experiencing impaired performance when using SOF storage volumes (/gws/nopw/j04/* and CEDA Archive volumes). The issue is under investigation with the storage vendor.

JASMIN login services are available - issue resolved

Tue, 28 Feb 2023 11:59:35 +0000

Dear JASMIN user,

We believe that the recent issue that affected the PURE storage system that hosts the home users directories and some small-files group workspaces is now resolved and JASMIN login services are operational.

JASMIN login services currently unavailable - issue under investigation

Fri, 24 Feb 2023 15:16:16 +0000

Dear users,

JASMIN login services are currently unavailable because of issues with the home users directories. The issue is currently being investigated with the storage vendor.

Issues with PFS storage affecting some JASMIN & CEDA services.

Mon, 13 Feb 2023 11:22:49 +0000

An issue with PFS storage volumes is currently being investigated with the vendor but may be affecting access to the following storage volumes used by CEDA and JASMIN services:

JASMIN and CEDA services issues

Fri, 10 Feb 2023 09:19:01 +0000

Dear Users

Some JASMIN and CEDA services have been affected by power supply instabilities overnight which have resulted in some systems being rebooted. Services are recovering.

UPDATE 2 - JASMIN maintenance work still in progress

Wed, 01 Feb 2023 10:55:25 +0000

Dear users,

Maintenance work is still in progress today.

Parallel File System (PFS) Storage
A second phase of the upgrade is now likely to be postponed to another date. PFS storage is running, but at reduced performance. This affects some CEDA Archive services, group workspaces with /gws/pw/j07 paths, /work/xfc and /work/scratch-pw[2,3] volumes
The old /work/scratch-pw volume should no longer be used and will be physically removed shortly.
LOTUS batch processing cluster: a reservation will remain in place until later today. An announcement will be made when this is lifted.

In summary: while many systems are back in operation, there is more work to be completed so in order to avoid disruption to their work, users are advised to avoid resuming work on the system until further notice.

Update on JASMIN maintenance Tues 31 Jan 2023 - window extended

Tue, 31 Jan 2023 16:55:46 +0000

Scheduled maintenance work today has progressed well but some tasks will require extending the maintenance window into tomorrow Wednesday 1st February 2023.

JASMIN GPU webinar, 31st Jan 2023 Agenda and joining details

Fri, 27 Jan 2023 15:38:31 +0000

Dear JASMIN user,

We will be hosting a webinar on Tuesday 31st January 2023 at 10:30 about JASMIN’s new GPU cluster, ORCHID. The event will provide information about ORCHID itself, as well as hearing from recent test users about their experiences with it. Users of other research GPU clusters will also talk about their use cases and experience.

Update on tape services and storage issues

Thu, 12 Jan 2023 17:13:28 +0000

Interruption to tape services (including week of 16-20 Jan)
The tape library is now functioning but with only one robot so performance is reduced. Please avoid using for now, as any jobs remaining over the weekend will likely need to be stopped ahead of scheduled maintenance due start on Monday 16th Jan for four days. Tape services should therefore be considered at reduced performance for now, but fully unavailable for most/all of next week. This affects Elastic Tape, JDMA, and Near-Line Archive (NLA) services.

Vacancy Storage Ops and User Support

Thu, 12 Jan 2023 10:08:49 +0000

We have a new exciting job opportunity to join our team. Further details at the link below.

Storage Ops and User Support (deadline - 29 January 2023)

Please contact the helpdesk if you need any additional information.

Interruption to tape services, update on storage issues

Wed, 11 Jan 2023 11:02:32 +0000

Interruption to tape services:
The tape library is currently out of service due to essential maintenance work. It had been hoped that the work involved could be carried out without an interruption to users but unfortunately this is now not the case: apologies for the short notice. This affects Elastic Tape, JDMA, and Near-Line Archive (NLA) services.

JASMIN GPU webinar, 31st Jan 2023

Wed, 11 Jan 2023 09:04:40 +0000

Dear JASMIN user,

We will be hosting a webinar on Tuesday 31st January 2023 at 10:30 about JASMIN’s new GPU cluster, ORCHID. The event will provide information about ORCHID itself, as well as hearing from recent test users about their experiences with it. Users of other research GPU clusters will also talk about their use cases and experience.

UPDATE - some group workspaces and virtual machines unavailable

Tue, 10 Jan 2023 09:54:27 +0000

Dear users,

Further to our earlier message, issues with the affected storage volumes are currently being resolved. Some are now available again while the root cause is still being investigated.

Some Group Workspace volumes currently unavailable - issue under investigation

Tue, 10 Jan 2023 09:15:25 +0000

Dear users,

Several Group Workspace volumes are currently not accessible because of a metadata server issue. The issue is currently being investigated with the storage vendor.

CEDA and JASMIN support over the Christmas period

Tue, 13 Dec 2022 09:12:03 +0000

As we approach the Christmas period, please be aware of the limited support arrangements in place which will result in CEDA and JASMIN services running “at-risk”.

Reminder JASMIN planned mini maintenance and other updates - Tuesday 22nd November

Mon, 21 Nov 2022 10:02:29 +0000

Dear users,

Please note the upcoming “mini” maintenance day on Tuesday 22nd November. The following system work/enhancements are also planned for that date in order to minimise disruption:

JASMIN planned mini maintenance and other updates - Tuesday 22nd November

Wed, 09 Nov 2022 09:59:16 +0000

Dear users,

Please note the upcoming “mini” maintenance day on Tuesday 22nd November. The following system work/enhancements are also planned for that date in order to minimise disruption:

JASMIN used to show Tonga volcano had highest plume ever recorded

Fri, 04 Nov 2022 14:38:05 +0000

Satellite images confirm that the Tonga eruption in January 2022 produced the highest ever recorded volcanic plume, at 57 km high. The open-source data used to confirm this finding was processed on JASMIN - the UK’s data analysis facility for environmental science.

Reminder - JASMIN planned maintenance and updates - Tuesday 18th October

Fri, 14 Oct 2022 08:56:02 +0000

Dear users,

Please note the upcoming maintenance work affecting JASMIN on Tuesday 18th October. The following system work/enhancements are also planned for that date in order to minimise disruption:

Reminder Tape services maintenance 8-9 August 2022

Mon, 08 Aug 2022 10:21:56 +0000

Dear Users

Tape services will be out of action from midday on Monday 8th August 2022 until the afternoon of Tuesday 9th August 2022, to enable updates to be applied to firmware and software components of the tape library and servers involved in the delivery of tape services.

JASMIN Reminder “possible” service interruption from 930am until 2pm on Monday 1st August 2022

Mon, 25 Jul 2022 08:28:03 +0000

Dear users,

Please note upcoming maintenance work with “possible” service interruption affecting JASMIN from 9:30am until 2pm on Monday 1st August. The LOTUS batch processing cluster will be unavailable for the duration of the work on the day, to avoid running jobs being adversely affected. A reservation will start at 06:00 am on the day, but any job submitted before that with a running time that goes over the reservation period will not start until after the reservation has finished. We will release the reservation early if the work is completed early.

JASMIN warning on possible disruptions on 18th-19th July

Mon, 18 Jul 2022 08:18:06 +0000

Dear users,

Please note that there is potential for disruption to JASMIN services from Monday 18th July at 10am till Tuesday 19th July evening as a result of extreme heat forecast for RAL, where JASMIN is hosted. It may become necessary to take action to reduce load on JASMIN if cooling equipment is unable to keep up with demand

JASMIN Reminder of maintenance work on weekend of 18/19 June and extended at risk period 20-24 June

Mon, 20 Jun 2022 10:39:49 +0000

Dear users,

Please note upcoming maintenance work and extended “at risk” period affecting JASMIN & CEDA next week:

Advance notice of STFC network intervention, 18-19 June 2022

Over the weekend of 18/19 June, there will be NO ACCESS to the RAL network, in which JASMIN is hosted, so there will be no access to JASMIN and CEDA services. Work is expected to continue on Monday 20th & Tuesday 21st June affecting some or all parts of the network. This work is being carried out by STFC’s network team. We will provide further details as these become available.

Reminder of maintenance work on weekend of 18/19 June and extended at risk period 20-24 June

Fri, 17 Jun 2022 09:32:35 +0000

Please note upcoming maintenance work and extended “at risk” period affecting JASMIN & CEDA next week:

Advance notice of STFC network intervention, 18-19 June 2022

Over the weekend of 18/19 June, there will be NO ACCESS to the RAL network, in which JASMIN is hosted, so there will be no access to JASMIN and CEDA services. Work is expected to continue on Monday 20th & Tuesday 21st June affecting some or all parts of the network. This work is being carried out by STFC’s network team. We will provide further details as these become available.

At risk period 16th June, Today

Thu, 16 Jun 2022 07:46:31 +0000

Dear users,

Please note upcoming “at risk” period and maintenance work affecting JASMIN & CEDA this week and next week:

JASMIN Update and reminder of maintenance work on weekend of 18/19 June

Wed, 15 Jun 2022 08:20:49 +0000

Dear users,

Please note upcoming maintenance work affecting JASMIN & CEDA during next week:

Quarterly maintenance day & storage update: 14th June completed!

Work to update storage systems is now completed. Important updates were applied to systems within the JASMIN infrastructure in order to keep them up to date and secure. Users are now able to access JASMIN.

Application software for JASMIN / LOTUS is now accessible and sci3 will be rebooted tomorrow at 7am

Wed, 25 May 2022 15:07:54 +0000

Dear Users,

We are pleased to announce that the problem with the host which serves application software in JASMIN/LOTUS was resolved. Applications and libraries available via the module environment /apps/modulefiles or /apps/contrib are now accessible

Application software for JASMIN / LOTUS currently not accessible

Wed, 25 May 2022 08:40:20 +0000

There is currently a problem with the host which serves application software in JASMIN/LOTUS. It is currently not accessible, which means that it is not possible to load any modules under /apps/modulefiles or /apps/contrib. The issue is currently being investigated.

JASMIN update on SLURM Scheduler upgrade

Fri, 20 May 2022 10:01:18 +0000

Dear users,

Further to our recent notice about forthcoming maintenance periods and upgrade to the SLURM scheduler, please note the following update:

JASMIN update on forthcoming maintenance periods May-June 2022

Mon, 16 May 2022 08:28:02 +0000

Dear users,

Please note the current/upcoming maintenance work affecting JASMIN:

This week: SLURM scheduler upgrade in progress
LOTUS batch processing cluster unavailable for most of this week

JASMIN update on SLURM Scheduler upgrade - starts Friday 13th May 2022

Fri, 13 May 2022 08:30:29 +0000

Dear users,

Further to our recent notice about forthcoming maintenance periods and upgrade to the SLURM scheduler, please note the following update:

JASMIN SLURM scheduler upgrade w/c 16 May 2022

Tue, 10 May 2022 07:30:01 +0000

Dear users,

Further to our recent announcement about maintenance periods in May/June 2022, please note the following additional item:

SLURM Scheduler upgrade, week commencing 16 May 2022

JASMIN update on forthcoming maintenance periods May-June 2022

Thu, 05 May 2022 08:57:53 +0000

Dear users,

Please note the following announcements for your information:

Reboot of nx-login servers 09:30 Thurs 5th May

NX login servers (nx-login[123].jasmin.ac.uk) will be rebooted at 09:30 tomorrow Thursday 5th May to apply new licences. This will cause a break in connected sessions so please ensure you are logged out of these servers before this time to avoid any problems.

JASMIN 29th March maintenance work now CANCELLED, advance notice of network Intervention 18-22 June

Mon, 28 Mar 2022 08:23:57 +0000

Dear users,

1. CANCELLED: Further storage maintenance 29th March 2022

Maintenance work on storage scheduled for tomorrow 29th March has now been cancelled by the vendor. A new date will be arranged in due course so please look out for further announcements.

REMINDER - JASMIN further maintenance period 29th March

Mon, 21 Mar 2022 09:24:42 +0000

Dear users,

A major component of the recent work scheduled for 1st March was not able to take place, so an alternative date has now been set for this part of the work.

Tape Maintenance 18th to 28th March

Tue, 15 Mar 2022 15:58:15 +0000

Dear Users,

Due to a Tape Library expansion and upgrade, the tape services offered by CEDA and JASMIN will be unavailable from midday on Friday 18th March until the morning of Monday 28th March 2022.

Final reminder - JASMIN upcoming maintenance periods

Mon, 28 Feb 2022 09:21:24 +0000

Dear users,

This is the final reminder to please be aware of the following maintenance periods scheduled over coming weeks which may affect you:

Further Tape Maintenance 18th to 22nd February

Thu, 17 Feb 2022 15:19:07 +0000

Dear Users,

Due to a network upgrade, the tape services offered by CEDA and JASMIN will be unavailable from midday on Friday 19th February until the morning of Tuesday 22nd February 2022. This will affect the NLA, JDMA and ET services.

Issues affecting access to CEDA and JASMIN services for some users

Wed, 09 Feb 2022 12:14:50 +0000

Dear users,

We are aware that some users have been experiencing difficulties in reaching some JASMIN and CEDA services since earlier this month.

RESOLVED JASMIN issue with access roles

Wed, 19 Jan 2022 09:56:57 +0000

Dear Users,

We believe that the issue with JASMIN access roles is now resolved and missing access roles have been restored. Please contact support@jasmin.ac.uk if you find any remaining issues with your access roles.

The Coupled Model Intercomparison Project (CMIP) Survey

Mon, 17 Jan 2022 10:09:16 +0000

If you are part of a community that makes use of data from the Coupled Model Intercomparison Project (CMIP) , please consider completing the survey. Details from the project team below.

Vacancies Head of CEDA, Project Manager, JASMIN Director

Fri, 17 Dec 2021 10:04:51 +0000

We have three new exciting job opportunities to join our team. Further details are at the links below.

Head of Centre for Environmental Data Analysis (deadline extended to 23rd January)
Project Manager (deadline extended to 16th January)
JASMIN Director (deadline 23rd January)

Please contact the helpdesk if you need any additional information.

Tape services unavailable after 1700 today (14 Dec), network at risk 15 Dec

Tue, 14 Dec 2021 14:52:40 +0000

Dear Users,

In line with recent announcements regarding “at risk” status of tape services, please be aware that at 17:00 today, access to tape services will be closed in advance of RAL network reconfiguration work tomorrow Wednesday 15th December.
A network intervention planned for tomorrow (17:00-21:00) should not affect most JASMIN services, but there is the possibility of some disruption. Access to tape services is being paused to minimise the risk of tape operations over-running into the intervention period.

CEDA and JASMIN support over the Christmas period

Tue, 07 Dec 2021 12:12:45 +0000

As we approach the Christmas period, please be aware of the limited support arrangements in place which will result in CEDA and JASMIN services running “at-risk”.

JASMIN Issues with scratch and some other storage volumes, limited LOTUS support

Fri, 03 Dec 2021 10:27:20 +0000

Dear users,

We are aware of an issue with some PFS storage volumes, including:

/work/scratch-pw (but not /work/scratch-pw2)
/gws/pw/j05/ncas_obs
(possibility of other volumes /gws/pw/j05/*)

These volumes may be temporarily unavailable. LOTUS users are advised to use /work/scratch-pw2 while this is investigated with the storage vendor.
Please note that due to staff cover, response time on queries to the helpdesk may be slower than usual and we may not be able to respond to all queries individually. Please look out for further announcements.

CEDA leads UKRI’s net zero computing goals

Tue, 30 Nov 2021 13:44:34 +0000

The CEDA team are leading efforts in the UK’s research and innovation sector to reach net zero computing. Our data experts will recommend a plan to ensure all the digital tools used throughout the sector, from supercomputers to phones, will be carbon neutral by 2040.

JASMIN Updates reminder Network at risk 1st Dec - postponed

Tue, 30 Nov 2021 10:13:32 +0000

UPDATE: this work has now been postponed, please look out for further announcements. Apologies for the inconvenience, JASMIN Team.

Dear Users,

Jaspy update, new R (jasr) environment, and Notebook Service update to be released on 16/11/2021

Wed, 10 Nov 2021 10:57:36 +0000

Dear JASMIN users,

We are pleased to announce that (1) a new version of the Jaspy software environment, (2) a first (Jasr) R environment and an (3) update to the JASMIN Notebook Service software (using Jaspy) will be released on JASMIN on Tuesday 16th November.

Reminder Tape service maintenance 26/27 Oct

Mon, 25 Oct 2021 08:37:39 +0000

Dear users

There will be a downtime for tape services (affecting Elastic Tape, JDMA and the Near-Line Archive service) on Wednesday 27th October, to apply essential updates. All tape activity will need to be stopped during the work, so in order to drain the system, these services will be unavailable to users from Tuesday 26th October until the work is completed on Wednesday afternoon.

JASMIN update 1) Tape service maintenance 26/27 Oct 2) new scratch volume

Thu, 21 Oct 2021 09:24:10 +0000

Dear users,

Please note the following updates for your attention:

Tape service maintenance 26/27 October 2021

Reminder System Maintenance 5th October 2021

Mon, 04 Oct 2021 08:37:12 +0000

Reminder: System Maintenance planned for 5th October 2021.

Scheduled maintenance is planned for Tuesday 5th October 2021, which will cause some disruption to JASMIN and CEDA services. Systems will be “at risk” and may be unavailable for all or part of the day.

Brief network interruptions Wed 29 Sept 2021

Tue, 28 Sep 2021 12:36:07 +0000

Dear Users,

We have been informed by the site network team for JASMIN’s host institution, RAL, that on Wednesday 29th September (tomorrow), the RAL site firewall will be upgraded. This work will be carried out between 07:00 and 09:00 BST. This upgrade will cause 2 short breaks (<1 minute) as the firewall is updated, but during the 2 hour upgrade window, access to systems should be considered at risk.
Although brief, these interruptions may affect all CEDA and JASMIN services.

JASMIN 1) Cloud issues 2) System Maintenance 5 October 2021

Mon, 20 Sep 2021 09:54:52 +0000

Please note the following JASMIN announcements for your attention:

1) Issues affecting access to JASMIN Cloud via portal and SSH currently under investigation.
We are currently aware of some issues affecting management of virtual machines via the JASMIN Cloud Portal. The issues are being investigated with cooperation from the platform vendor. As far as we are aware, the virtual machines themselves are running normally and are still accessible via SSH. If you are a cloud tenancy admin and are aware of any further problems, please report these to the JASMIN Helpdesk.

New technical blog sharing expertise about managing petabytes of data

Wed, 15 Sep 2021 12:33:37 +0000

The CEDA team has a wealth of expertise in world-leading data management practices and software engineering that we use to support the environmental science community. We want to share our knowledge, best practices and lessons learnt with others - so have launched a new CEDA Technical Blog . This blog aims to showcase how our team uses open source tools to efficiently manage multi-petabytes of environmental data and collaborate with international research projects working on society’s most pressing environmental issues.

Vacancy two graduate roles

Fri, 10 Sep 2021 14:49:22 +0000

We have two new opportunities for graduates to join the CEDA team . Follow the links below for more information and how to apply.

1) Tape services maintenance 13-14 Sept, 2) Globus Endpoint changes.

Wed, 08 Sep 2021 13:03:06 +0000

Dear users

Please note the following JASMIN updates:

1) Tape services maintenance 13-14 September

Tape services including Elastic Tape and the Near-Line Archive service will be unavailable due to system maintenance/upgrade work on 13th & 14th September. User recalls and ingest of data will be stopped at 12:00 on Monday 13th September ahead of maintenance work on Tuesday 14th September.

JASMIN updates network maintenance

Wed, 18 Aug 2021 09:51:09 +0000

Dear users,

Please note the following update:

Network maintenance 21/22 August, at risk in between.

As part of work to upgrade the RAL core network (the network of CEDA and JASMIN’s host institution) to 100G, network components will be replaced during the weekend of 14th/15th August with follow-up work on 21st/22nd August. Connectivity between JASMIN/CEDA services and the outside world is expected to be disrupted over these 2 weekends to please plan your work accordingly to minimise inconvenience. The intervening week should be regarded as “at risk” and there is the possibility that changes made on the first weekend may need to be rolled back if the work cannot be completed successfully.

JASMIN updates network maintenance

Wed, 11 Aug 2021 08:41:19 +0000

Dear users,

Please note the following updates:

Network maintenance 14/15 & 21/22 August, at risk in between.
As part of work to upgrade the RAL core network (the network of CEDA and JASMIN’s host institution) to 100G, network components will be replaced during the weekend of 14th/15th August with follow-up work on 21st/22nd August. Connectivity between JASMIN/CEDA services and the outside world is expected to be disrupted over these 2 weekends to please plan your work accordingly to minimise inconvenience. The intervening week should be regarded as “at risk” and there is the possibility that changes made on the first weekend may need to be rolled back if the work cannot be completed successfully.

Important JASMIN updates August 2021

Tue, 10 Aug 2021 08:02:20 +0000

Dear JASMIN users,

This message includes information about important updates on JASMIN:

Kernel patching required on all JASMIN login, sci and data transfer servers
Kernel patching required across all LOTUS compute nodes
Maximum job array size and default memory allocation to be changed
Short-serial-4hr queue configuration has changed

Details of the update

JASMIN updates 1) network maintenance 2) elastic tape/JDMA

Tue, 27 Jul 2021 08:17:10 +0000

Dear users,

Please note the following updates:

1. Network maintenance 14/15 & 21/22 August, at risk in between.
As part of work to upgrade the RAL core network (the network of CEDA and JASMIN’s host institution) to 100G, network components will be replaced during the weekend of 14th/15th August with follow-up work on 21st/22nd August. Connectivity between JASMIN/CEDA services and the outside world is expected to be disrupted over these 2 weekends to please plan your work accordingly to minimise inconvenience. The intervening week should be regarded as “at risk” and there is the possibility that changes made on the first weekend may need to be rolled back if the work cannot be completed successfully.

CEDA and JASMIN support over summer period

Fri, 23 Jul 2021 15:15:41 +0000

As we approach the summer period, please be aware of the limited support arrangements in place which will result in CEDA and JASMIN services running “at-risk”.

LOTUS scheduler issues update

Mon, 19 Jul 2021 12:10:31 +0000

Update - 20th July 10 am:

While investigations continue into the root cause of recent problems, the cluster now appears to be behaving normally.

Reminder JASMIN system maintenance tomorrow, Tuesday 6th July 2021

Mon, 05 Jul 2021 08:40:20 +0000

Dear users,

Scheduled maintenance is planned for tomorrow, Tuesday 6th July 2021, which will cause some disruption to JASMIN and CEDA services. Systems will be “at risk” and may be unavailable for all or part of the day.

Supporting COP26 hackathons

Thu, 01 Jul 2021 09:59:51 +0000

Researchers across the UK have been hacking their way through Terabytes of climate data ahead of the 26th UN Climate Change Conference of the Parties ( COP26 ) in Glasgow on 1st-12th November 2021. Three virtual hackathon events were run, during May and June 2021, by a range of UK Universities and the Met Office, covering various topics:

JASMIN status updates and reminder of planned maintenance Tuesday 6 July

Thu, 24 Jun 2021 12:44:56 +0000

Dear all,

See below for an update on various aspects of JASMIN services and dates for your diary. Note that these updates are also available on the website news section.

JASMIN helps to predict seabird breeding abundance in a changing climate

Tue, 08 Jun 2021 10:28:59 +0000

Many of us have been to the coast and seen seabirds, but have you ever considered how they might be affected by climate change? The UK is surrounded by important populations of seabirds, including Arctic Tern, Kittiwake, and Puffin, that play a key role as top predators and indicators of the health of marine ecosystems. Like many animals, seabirds are exposed to climate change in both marine and terrestrial environments, but the combined effects are rarely considered. Climate change impacts seabird species through a number of mechanisms; for example, by shifting the distributions of prey species, influencing storminess which affects mortality rates, causing overheating at the nest site, or increasing sea level and reducing available breeding habitat. CEDA services were used by researchers at the British Trust for Ornithology (BTO) to predict future seabird abundance under both marine and terrestrial climate change, as part of the Marine Protected Area Management and Monitoring ( MarPAMM ) project.

Vacancy JASMIN Research Software Engineer

Tue, 08 Jun 2021 09:23:57 +0000

We have an exciting opportunity to join our team as a Research Software Engineer, where you will develop and maintain software used to deliver JASMIN , and to operate processes which support users in their work on the JASMIN platform.

Reminder New Jaspy python3.7 version to be released on 20/05/2021

Mon, 17 May 2021 08:21:48 +0000

Dear JASMIN users,

We are pleased to announce that a new version of the JASPY Python 3.7 software environment has been released on JASMIN. It is currently ready for testing on the JASMIN “sci” servers and the LOTUS cluster.

Reboot of servers for software update, interruption in access to object store

Thu, 13 May 2021 08:25:29 +0000

Dear users,

Rescheduled work to apply a storage-related software update to key JASMIN servers (sci, xfer, hpxfer and a limited number of other machines) will take place on Friday 14th May 2021 at 08:30-10:00. A further intervention will take place during the day on Monday 17th May to reboot any servers which have not picked up the update automatically by then. In both cases, please look out for announcements at the console/command line on the machine. Sessions will be interrupted while the server is rebooted but you should be able to re-connect again after a few minutes when the machine has come back up.

1) Cancelled Reboot of servers Tuesday 11 May 2021 2) Tape library maintenance

Tue, 11 May 2021 09:32:12 +0000

Dear all,

Apologies for the short notice but the reboot of servers planned for today announced in our recent update is cancelled. This is due to the imminent availability of a newer release which will be rolled out in due course instead, timing TBC.

Reboot of servers Tuesday 11 May 2021

Thu, 06 May 2021 08:10:01 +0000

Dear all,

As anticipated in our recent update, a software update is now available which should address the remaining disk storage issue mentioned in earlier announcements. This update is already being rolled out across the JASMIN platform but will require a reboot of most JASMIN and CEDA servers in order to take effect.

Reminder Network interruption tomorrow, Wed 21 April 2021

Tue, 20 Apr 2021 08:21:39 +0000

Tomorrow, Wednesday 21st April, upgrades by our host institution to the RAL site firewall will be undertaken between 06:00 and 10:00. This will involve some disruption to all services using the RAL network: this includes JASMIN and CEDA services. Please be aware of this scheduled interruption so that you can plan your work accordingly.

Cloud Upgrade, May 2021

Tue, 06 Apr 2021 08:32:23 +0000

Dear cloud tenants,

We are planning a major upgrade to JASMIN’s Cloud in May this year: The work will bring the cloud from the current “Queens” version of OpenStack to the latest compatible supported release, “Train”.

Reminder Access to CEDA and JASMIN services at risk today and tomorrow (30-31 March 2021)

Tue, 30 Mar 2021 08:02:50 +0000

Please be aware that due to Domain Name Server (DNS) upgrades undertaken by our host institution on 30 and 31 March 2021, there could be delays or interruptions to access to CEDA and JASMIN services after 18:00 on each of these dates.

Oceans in the Cloud working interactively with huge datasets using Pangeo

Tue, 23 Mar 2021 14:44:29 +0000

The properties of our oceans are changing. The Southern Ocean absorbs more heat than any other ocean and as a consequence of climate change, it is warming at an alarming rate. Warming oceans lead to a decline in Antarctic sea ice, increased ocean freshening, sea-level rise, reduced oxygen and CO2 uptake and slow the vertical exchange of waters. This may bring about increased food scarcity, diseases, extreme weather events, loss of coastal protection, and more. It is therefore extremely important to have a detailed understanding of what could happen in the future with a Southern Ocean that is warmer, less salty and is circulating in different ways.

Reminder Brief network interruptions Today, 10th March

Wed, 10 Mar 2021 08:00:15 +0000

Dear users,

Please be aware that due to scheduled network maintenance carried out by our host organisation, there will be a series of brief interruptions to network connectivity (a few seconds each) today, Wednesday 10th March 2021, between 09:00 and 10:30.
These will affect network connections to the RAL site (and hence JASMIN and CEDA services), so may result in disconnected terminal sessions, interruptions to processing or data transfers in progress or availability of services.
We are informed that the interruptions will also affect connections made using the Optical Private Network (OPN) connections to Leeds, Edinburgh and the Met Office.

JASMIN System Maintenance - now complete

Wed, 03 Mar 2021 11:08:05 +0000

The scheduled maintenance that happened yesterday, Tuesday 2nd March 2021, is now completed.

Most JASMIN and CEDA services are back running as normal. However, there are ongoing issues related to access to MASS. We are working on resolving this ASAP.

Final Reminder JASMIN System Maintenance Tomorrow - Tues 2 March 2021

Mon, 01 Mar 2021 09:42:56 +0000

Scheduled maintenance is planned for tomorrow, Tuesday 2nd March 2021, which may cause some disruption to JASMIN and CEDA services.

Update to high-performance data transfer services

Fri, 26 Feb 2021 13:26:52 +0000

Dear users,

As previously announced, we are making further changes to some data transfer services:

ftp.ceda.ac.uk (CEDA Archive FTP server)
The new host for this service will operate at the same name ftp.ceda.ac.uk, but if you have used the hostname ftp2.ceda.ac.uk directly, then you are advised to change to using the alias ftp.ceda.ac.uk so that the change happens transparently to you when the old server is decommissioned.
JASMIN GridFTP Server Globus Endpoint
The Globus endpoint will change to a new server on Tuesday 2nd March. If you are using the “JASMIN GridFTP Server” Globus endpoint via Globus web or command-line interfaces, the endpoint ID of the service will remain the same but the server at the JASMIN end will change. This should only affect transfers in progress at the time of the change, so impact should be minimal given that this coincides with the planned maintenance day already announced.
However, if you use certificate-based gridftp (gsiftp) directly i.e, not via Globus Online interfaces, but with the globus-url-copy client, then the hostname data-xfer1.ceda.ac.uk will need to be replaced with gridftp1.jasmin.ac.uk in your gsiftp:// URIs. All other aspects should remain the same.

We are still investigating an issue affecting transfers to and from some file system (particularly affecting transfers made using Globus) and this is still not yet fully resolved.

Reminder Notice JASMIN System Maintenance Tues 2 March 2021

Tue, 23 Feb 2021 09:22:36 +0000

Scheduled maintenance is planned for Tuesday 2nd March 2021, which may cause some disruption to JASMIN and CEDA services.

On a regular (roughly quarterly) basis, important updates are applied to systems within the JASMIN infrastructure (which also hosts the CEDA Archive and associated services) in order to keep them up to date and secure. Some servers may need to be rebooted in order for these changes to take effect, so there may be an interruption to some JASMIN and CEDA services on this date.
Other work may also be scheduled for this date in order to minimise disruption to users.

Update Problems with Elastic Tape

Fri, 19 Feb 2021 14:48:15 +0000

We believe that the problems affecting Elastic Tape and JDMA to now be solved. Users can now start using the services again.

reboot of server nx-login2 at 1600 today

Wed, 17 Feb 2021 14:03:12 +0000

Server nx-login2.jasmin.ac.uk needs to be rebooted at 16:00 today, Wednesday 17th February, to clear up dead/hanging processes.

We apologise for any inconvenience this may cause.

JASMIN Sci3,5 reboot at 0900 AM TOMORROW!

Tue, 16 Feb 2021 13:51:24 +0000

Dear JASMIN users,

The JASMIN scientific analysis machines sci[3,5].jasmin.ac.uk need to be rebooted at 09:00 AM tomorrow, Wednesday 17th February, to clear up dead/hanging processes.

Problem with LOTUS batch scheduler - SLURM

Thu, 11 Feb 2021 13:30:00 +0000

13:30 11th Feb - update 1

There is currently an issue with the LOTUS batch scheduler - SLURM. This has manifested in unusually long pending time per job, a slow response time when querying SLURM and occasional failed job submissions.We are aware of the issue and are working on a resolution. Please do not email the helpdesk about issues related to SLURM. We will update you when we know more.

Reminder Update to high-performance data transfer services

Thu, 11 Feb 2021 08:58:23 +0000

Dear users,

As announced last week, the following servers will be decommissioned tomorrow Friday 12th Feb:

jasmin-xfer[23].ceda.ac.uk (high-performance data transfer servers)
now replaced by hpxfer[12].jasmin.ac.uk: please use these instead.
ftp.ceda.ac.uk (CEDA Archive FTP server)
The new host for this service will operate at the same name ftp.ceda.ac.uk, but if you have used the hostname ftp2.ceda.ac.uk directly, then you are advised to change to using the alias ftp.ceda.ac.uk so that the change happens transparently to you when the old server is decommissioned.

We have been aware for a while of an issue affecting transfers to and from some file system (particularly affecting transfers made using Globus) but this is still under investigation. Please look out for further announcements about this and replacement of the remaining high-performance data transfer servers.

Job opportunity - JASMIN Software Developer

Wed, 10 Feb 2021 17:14:49 +0000

Job opportunity - JASMIN Software Developer

We are looking for an enthusiastic individual to contribute to the evolution of JASMIN – our globally unique facility for data-intensive computing for the environmental sciences. You will be working with world experts developing innovative technical solutions to address the challenge of building, growing and maintaining an infrastructure to support the needs of researchers in their work processing and analysing complex, high volume scientific data.

File corruption issues

Thu, 04 Feb 2021 16:59:16 +0000

Dear users

As reported last week, we have been dealing with an issue of apparent file corruption affecting a relatively small number of files in some volumes with paths beginning /gws/nopw/j04.
We have been receiving assistance from the storage vendor to resolve the issue and are now in a position to announce that the majority of affected files have now been successfully repaired, with no loss of user data. A process to scrub/repair a remaining list of some 1,281 files (as of earlier today) is now underway and should complete over the coming weekend. 1.4 billion files have now been checked by this process.
The vendor has provided further updated software releases which have been applied and we are now confident that once the above process has been completed, there should be no further cause for concern.

Update to high-performance data transfer services

Mon, 01 Feb 2021 15:35:52 +0000

Dear users,

You will be aware that many JASMIN and CEDA services were redeployed from RHEL6 to CentOS7 operating systems last year. The final few services - those deployed on physical servers in the JASMIN Data Transfer Zone - are now nearly ready for user access, so please note the following if you make use of these services:

JASMIN helps track the impact of climate change on UK birds

Thu, 28 Jan 2021 09:32:31 +0000

Over 600 different species of birds have been recorded in the UK to date[1] . For many of them formal monitoring is limited or absent. British Trust for Ornithology (BTO) ask for volunteers from the public to report nature observations from around the UK on mobile apps or online data entries such as BirdTrack . This is important because estimating bird distributions and population trends increases our knowledge about bird species or their habitats. Over 60,000 volunteers are involved recording bird species, resulting in a massive amount of data collected - in 2020 alone over 7.5 million records have been submitted to BirdTrack. Researchers at BTO have been using JASMIN to carry out statistical analysis on these data in order to better understand the reliability of Citizen Science data and the changes in UK bird populations that can be inferred from it.

File corruption issues

Tue, 26 Jan 2021 12:43:07 +0000

Dear users

We are aware of reports of apparent file corruption affecting a relatively small number of files in some volumes with paths beginning /gws/nopw/j04.
We have been receiving assistance from the storage vendor to resolve the issue and measures are now underway to repair affected files. As we understand the situation at present, no action is needed by users at this time.

Reboot of server hpxfer1.jasmin.ac.uk

Mon, 25 Jan 2021 14:25:33 +0000

Server hpxfer1.jasmin.ac.uk will be rebooted at 09:00 on 26/1/2021 to clear some stuck processes.

Apologies for any inconvenience.

JASMIN Team

JASMIN Sci3,6,8 reboot at 0830 AM TOMORROW!

Wed, 20 Jan 2021 14:57:59 +0000

Dear JASMIN users,

The JASMIN scientific analysis machines sci[3,6,8].jasmin.ac.uk need to be rebooted at 08:30 AM tomorrow, Thursday 21st January, to clear up dead/hanging processes.

Reminder - Change of server for Elastic Tape service.

Wed, 20 Jan 2021 09:19:40 +0000

The server used to access the Elastic Tape service (et1.ceda.ac.uk) has reached its end of life and is due to be decommissioned.

Update COVID-19 impact on CEDA and JASMIN operations

Tue, 05 Jan 2021 10:54:36 +0000

At the beginning of the Covid-19 pandemic, we announced that all of our services should be considered at risk. Thankfully, our services have run largely as normal throughout the pandemic, but 10 months on, unfortunately, this ‘at risk’ status still stands. See below for details about how we anticipate it will continue to affect us and you.

Helping users get the most out of JASMIN in 2020

Wed, 16 Dec 2020 10:35:01 +0000

JASMIN is a large and multi-faceted research facility that continues to grow in response to demand from growing numbers of users from a wide range of academic communities. Helping users get the most out of JASMIN is an important part of our remit. Here we highlight four different activities that have been undertaken by the JASMIN team in 2020.

Reminder CEDA and JASMIN support over Christmas period

Fri, 11 Dec 2020 10:37:15 +0000

A reminder there is a “change freeze” in place from 17:00 today. Requests for new or changes to existing services will not be dealt with until the New Year.

NLA unavailable from Fri 4th to Tues 7th Dec 2020

Wed, 02 Dec 2020 15:46:20 +0000

The Near-Line Archive (NLA) tape system will be unavailable from the evening of Friday the 4th December until Monday the 7th December 2020.
No new retrievals will be accepted from the evening of Friday 4th December, so as to allow any remaining retrievals to finish over the weekend.

CEDA and JASMIN support over Christmas period

Tue, 01 Dec 2020 09:42:24 +0000

As we approach the Christmas period, please be aware of the limited support arrangements in place which will result in CEDA and JASMIN services running “at-risk”.

New JASMIN website live

Mon, 30 Nov 2020 16:54:16 +0000

We are delighted to announce the launch of our brand new JASMIN website - https://www.jasmin.ac.uk/ . Take a look to see the difference!

Some CEDA/JASMIN Services unavailable

Fri, 27 Nov 2020 14:58:08 +0000

Over the last year, the team has worked hard to migrate all of our services to a new operating system (CentOS7). The deadline for this work to be achieved is Monday 30th November. The majority of user-facing services have now been migrated successfully with minimal disruption to users. However, a small number of services still need to be migrated.

LOTUS/SLURM issues update 2

Wed, 25 Nov 2020 12:16:30 +0000

In the past month, and following the configuration changes to LOTUS over the summer, we have not been able to fully resolve issues around longer queue wait times, despite the mechanisms outlined here.

Reminder JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 13

Mon, 16 Nov 2020 09:56:27 +0000

Dear JASMIN users,

New MASS client server is available
Old mass-cli1.ceda.ac.uk server will be retired on Tuesday 17th November
Old jasmin-cylc.ceda.ac.uk has been retired
JASPY default version was updated on Tuesday 3rd November
Reminder to use the new login, sci and xfer servers
SLURM update

Details of the update

The new CentOS7 MASS mass-cli.jasmin.ac.uk server is now available for use.

Short JASMIN outage on Wednesday 4th November at 7am

Thu, 29 Oct 2020 11:39:57 +0000

Dear Users,

JASMIN’s host institute at RAL are planning some short breaks in connectivity for a site wide firewall firmware upgrade. This will affect all access to JASMIN - except the DTZ machines and external cloud.

Reminder - JASMIN‌ ‌Migration‌ ‌to‌ ‌CentOS7‌ ‌&‌ ‌LSF‌ ‌replacement‌ ‌with‌ ‌SLURM‌ ‌UPDATE‌ ‌12‌

Mon, 26 Oct 2020 11:36:33 +0000

Dear JASMIN users,

New CentOS7 MASS client server
Old jasmin-cylc.ceda.ac.uk to be retired on Tuesday 3rd November.
JASPY default version will be updated on Tuesday 3rd November.
Reminder to use the new login, sci and xfer servers
Closing down LSF and removing access to LOTUS head node
Support for parallel NetCDF libraries (under /apps/jasmin/)
ESMValTool installed on JASMIN

Details of the update

Reboot of Globus/GridFTP server 22 Oct 1700

Thu, 22 Oct 2020 14:05:15 +0000

The server used as the “JASMIN GridFTP Server” Globus endpoint (data-xfer1.ceda.ac.uk), will be rebooted at 17:00 in an attempt to clear a performance issue.

LOTUS reservation for benchmark work on Saturday 17th October from 4 PM to 8 PM

Thu, 15 Oct 2020 13:42:40 +0000

Dear JASMIN user,

The LOTUS batch processing cluster will be unavailable for the duration of the benchmark work. The SLURM batch reservation will start on Saturday 17th October from 4 PM to 8 PM. Any job submitted before that time with a running time that goes over the reservation period will not start until after the reservation has finished. Note: jobs submitted to the long-serial queue may be affected.

‘LOTUS reservation for benchmark work’ 10 October 4pm - 8pm and 17 October 4pm to 8pm.

Fri, 09 Oct 2020 13:30:30 +0000

Dear JASMIN user,

The LOTUS batch processing cluster will be unavailable for the duration of the benchmark work. The SLURM batch reservation will start on Saturday 10 October 4pm - 8pm and Saturday 17th October 4pm to 8pm. Any job submitted before that time with a running time that goes over the reservation period will not start until after the reservation has finished.
Note: jobs submitted to the long-serial queue may be affected.

Update to opensearch.ceda.ac.uk

Tue, 06 Oct 2020 10:15:44 +0000

We will be making a quick update to opensearch.ceda.ac.uk at 13:00 today (6th October 2020).

This is as part of the JASMIN migration work which has been ongoing throughout the summer.

LOTUS/SLURM issues update

Tue, 06 Oct 2020 08:53:22 +0000

Dear all,

As you know we have recently seen some problems with the SLURM scheduler for the LOTUS batch processing cluster, with jobs remaining in the pending state for much longer than normal. This issue has been and remains a top priority for the JASMIN team to resolve. Here’s the current state of affairs:
• Today (Monday 5 Oct)
o Fair-share configuration has been adjusted to attempt to lower the priority of very large/long-running jobs (which were causing sections of the cluster to become blocked)
o An even mix of user ids is now being seen with running and pending jobs, implying that jobs are now starting to flow more normally, without being dominated by any one user.
o A fix to a storage client has been rolled out to some parts of JASMIN which fixes a write issue for some users (NB not necessarily related to scheduling issues)

Backlog of helpdesk queries - delayed response likely

Wed, 30 Sep 2020 15:35:04 +0000

Dear all,

We are experiencing extremely high numbers of helpdesk queries on the JASMIN helpdesk and now have a significant backlog.

Some sci machines unavailable on Monday 21 Sept at ~0830-840

Fri, 18 Sep 2020 13:47:29 +0000

The following scientific analysis servers will be unavailable for 5-10 minutes on Monday, 21st September at 08:30 AM for memory changes:

System maintenance Tues 15 Sept 2020

Mon, 14 Sep 2020 15:51:50 +0000

Scheduled maintenance is planned for Tuesday 15th September, which may cause some disruption to JASMIN and CEDA services.

On a regular (roughly quarterly) basis, important updates are applied to systems within the JASMIN infrastructure (which also hosts the CEDA Archive and associated services) in order to keep them up to date and secure. Some servers may need to be rebooted in order for these changes to take effect, so there may be an interruption to some JASMIN and CEDA services on this date. The maintenance work will also include a network change which should help prevent recent problems experienced with the virtualization cluster.

Reminder JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 10

Fri, 28 Aug 2020 09:22:34 +0000

Dear JASMIN users,

This message includes information about the following:

Update on SLURM and the CentOS7 LOTUS cluster
Timeline to retire old RHEL6 login, sci and data transfer servers
New high-memory CentOS7 sci machines

Details of the update

JASMIN Services Updates

Tue, 25 Aug 2020 10:41:20 +0000

Dear Users,

We would like to update you about the issues that affected the JASMIN virtualisation platform yesterday, Monday 24th August. Those issues have now been resolved and all JASMIN Services are back online.

Save the date! JASMIN2020 virtual event

Tue, 04 Aug 2020 09:37:17 +0000

This online event will take place on the mornings of Tuesday 29th and Wednesday 30th September - and is free to attend.

UPDATE Tape system upgrade completed services now available for use

Tue, 28 Jul 2020 08:15:00 +0000

Maintenance work to add additional capacity to the tape library has now been completed including tests to check that all is operating as expected. The tape library, and hence all tape services: Elastic Tape (ET) and StorageD (SD) and Near Line Archive (NLA) are therefore ready for use again.

Reminder - IMPORTANT Changes to Scratch Storage

Mon, 27 Jul 2020 10:18:00 +0000

Dear JASMIN users,

As previously announced:

The old scratch volume /work/scratch remains available READ ONLY until Friday 31st July but will then be retired.
A new volume /work/scratch-pw is now in place on PFS (parallel file system) storage with a total capacity of 1 Petabyte.
Both /work/scratch-pw and /work/scratch-nopw have automated processes to “police” usage by deleting files that have not been accessed for the past 28 days.

Please be aware that this automated clearout process is now running on a weekly basis.

UPDATE Tape systems unavailable (duration extended)

Mon, 27 Jul 2020 09:43:21 +0000

Dear users,

As previously announced, maintenance work is currently underway to add additional capacity to the tape library shared by CEDA and JASMIN tape services. The tape library, and hence all tape services: Elastic Tape (ET) and StorageD (SD) and Near Line Archive (NLA) are currently unavailable.

UPDATE Tape systems unavailable 21-28 July (duration extended)

Mon, 20 Jul 2020 08:35:29 +0000

Dear users,

Maintenance work previously announced for 22-24 July 2020 will add additional capacity to the tape library shared by CEDA and JASMIN tape services. The tape library, and hence all tape services: Elastic Tape (ET) and StorageD (SD) and Near Line Archive (NLA) will be unavailable for this period.

Reminder - IMPORTANT Changes to Scratch Storage

Thu, 16 Jul 2020 08:41:43 +0000

Dear JASMIN users,

As previously announced:

The old scratch volume /work/scratch remains available READ ONLY until Friday 31st July but will then be retired.
A new volume /work/scratch-pw is now in place on PFS (parallel file system) storage with a total capacity of 1 Petabyte.
Both /work/scratch-pw and /work/scratch-nopw have automated processes to “police” usage by deleting files that have not been accessed for the past 28 days.

Please be aware that this automated clearout process will now start running on a weekly basis from this Friday 17th July.

JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 9

Fri, 03 Jul 2020 10:59:06 +0000

This message includes information about the following:

Update on SLURM & CentOS7 LOTUS cluster
sci[1,2].jasmin.ac.uk with SLURM enabled
New CentOS7 JASMIN cylc server
New CentOS7 cron server

Details of the update

1. More LOTUS hosts have been migrated to CentOS7 and added to the pool of hosts managed by the new batch scheduler SLURM. All LOTUS users are expected to use SLURM. The recording and PPT presentation of the first webinar on transitioning from LSF to SLURM are now available here

Reminder User survey to gauge needs in preparation for purchase of a new GPU cluster

Mon, 29 Jun 2020 09:23:13 +0000

This is just a reminder that the planned 2020 upgrade for JASMIN will include a substantial upgrade to JASMIN GPU capacity. While we have a panel of experts helping us develop requirements, it will be useful for us to get direct feedback about actual and potential GPU usage within the community of existing and potential JASMIN users. To that end we have a short survey. It should only take 5-10 minutes to complete, and we would value you doing that before the end of June.

JASMIN and CEDA services affected by power outage - now resolved

Mon, 22 Jun 2020 17:14:59 +0000

Update 1 - 22/06/2020 17:00

JASMIN and CEDA Archive services have been offline today due a power outage that affected the entire RAL site (including the JASMIN machine room) at approximately 13.30 on Monday 22 June 2020. The power is now back, but not all remaining actions can be carried out remotely.

User survey to gauge needs in preparation for purchase of a new GPU cluster

Mon, 22 Jun 2020 09:02:32 +0000

The planned 2020 upgrade for JASMIN will include a substantial upgrade to JASMIN GPU capacity. While we have a panel of experts helping us develop requirements, it will be useful for us to get direct feedback about actual and potential GPU usage within the community of existing and potential JASMIN users. To that end we have a short survey. It should only take 5-10 minutes to complete, and we would value you doing that before the end of June.

Changes to JASMIN Helpdesk

Tue, 16 Jun 2020 10:53:46 +0000

We are pleased to announce some changes to our user support services, aimed at improving the experience for users and making our helpdesk processes more efficient.

Reminder JASMIN at-risk period 11th June 2020

Wed, 10 Jun 2020 08:58:33 +0000

We previously announced electrical work planned for the RAL site around the Bank Holiday weekend of 22nd-25th May, which carried with it a small risk of disruption to JASMIN’s power supply. In fact, the main part of this work has now been re-scheduled to Thursday 11th June 2020. The risk of disruption is small but if it occurs would result in all JASMIN and CEDA services being offline for several days if power was lost.

JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 8

Fri, 05 Jun 2020 10:56:13 +0000

Dear JASMIN users,

This message includes information about the following:

Update on SLURM & CentOS7 LOTUS cluster
New MPI implementation on LOTUS
SLURM/LOTUS webinar
LSF-managed LOTUS resources to be reduced from mid-June.

Important reminder about the timescale: the current batch system will be unavailable after the end of June 2020. After this, users will be expected to use SLURM.

JASMIN at-risk period 11th June 2020

Tue, 02 Jun 2020 14:49:21 +0000

IMPORTANT Changes to Scratch Storage

Thu, 21 May 2020 14:55:45 +0000

Dear JASMIN users,

Please note the following changes which affect both /work/scratch and /work/scratch-nompiio
We are pleased to announce that a new scratch volume /work/scratch-pw will be available from Wednesday 27th May. This volume will be on PFS (parallel file system) storage with a total capacity of 1 Petabyte, but will have automated processes in place to “police” usage. This new volume, /work/scratch-pw will be a replacement for the current /work/scratch volume.

JASMIN low at-risk period 22nd - 25th May 2020

Mon, 18 May 2020 11:00:37 +0000

Electrical work planned on the RAL site has a small risk of loss of power to the JASMIN data centre around the Bank Holiday weekend (22nd-25th May). The risk of disruption is small but would result in all JASMIN and CEDA services being offline for several days if power was lost.

IMPORTANT Reminder The first purge of /work/scratch-nompiio is scheduled on 27th May

Mon, 18 May 2020 08:41:25 +0000

Dear JASMIN users,

The /work/scratch-nompiio volume will be purged on Wednesday 27th May to empty it and reprovision it with a new fixed quota of 90TB (from 120TB).

IMPORTANT The first purge of /work/scratch-nompiio is scheduled on 27th May

Fri, 15 May 2020 08:57:59 +0000

Dear JASMIN users,

The /work/scratch-nompiio volume will be purged on Wednesday 27th May to empty it and reprovision it with a new fixed quota of 90TB (from 120TB).

IMPORTANT information for ALL JASMIN USERS

Wed, 13 May 2020 16:03:11 +0000

Please check your email for an important announcement affecting all JASMIN users.

You will need to read this and take action before you next attempt to log in to JASMIN.

Reminder JASMIN maintenance & at-risk periods May 2020

Wed, 13 May 2020 08:33:53 +0000

Scheduled network maintenance on JASMIN is planned for Wednesday 13th May which requires a JASMIN downtime affecting CEDA and JASMIN systems including access to the CEDA Archive and JASMIN community cloud

JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 6

Tue, 05 May 2020 14:17:55 +0000

Dear JASMIN users,

We are pleased to announce the following:

Update on SLURM
New data transfer servers
New JASMIN login server

JASMIN maintenance & at-risk periods May 2020

Tue, 05 May 2020 08:41:58 +0000

Reminder JASMIN Maintenance Tomorrow 28 April 2020

Mon, 27 Apr 2020 08:24:11 +0000

A reminder that scheduled maintenance is planned for tomorrow 28th April 2020, potentially affecting some storage systems and services which rely on them.

Enabling essential climate science research

Wed, 22 Apr 2020 09:50:43 +0000

Climate Change is a defining issue of our time. The UK’s top 10 warmest years have all occurred since 2002, and July 2019 saw the UK’s hottest ever recorded temperature (38.7 °C). Whilst many are enjoying the unusually non-rainy British weather, it doesn’t come without costs. Extreme weather events, such as heatwaves and flash flooding, are expected to increase in severity and frequency as our climate continues to change. Extreme weather can adversely affect the way we live our lives. Loss of food production, damaging wildlife habitats, and endangering human life are just a few impacts associated with climate change. Predicting global climate change is complex and requires vast amounts of data processing capabilities. Steps must be taken to improve the accuracy of future climate models. That’s where JASMIN - a data intensive supercomputer - comes in.

Update on JASMIN Maintenance 21 April 2020

Wed, 22 Apr 2020 08:32:02 +0000

Following scheduled maintenance on parts of the JASMIN system yesterday, please note the following:

Servers were patched and rebooted where necessary to apply important updates. There were nearly double the number of hosts to update this time, as we transition from RHEL6 to CentOS7 operating systems, so this took longer than usual.

Reminder JASMIN Maintenance Today & 28 April 2020

Tue, 21 Apr 2020 08:25:30 +0000

Scheduled maintenance is planned for Today AND 28th April 2020, some of which will result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

Reminder JASMIN Maintenance Tues 21 & 28 April 2020

Mon, 20 Apr 2020 08:38:24 +0000

Scheduled maintenance is planned for Tuesday 21st AND 28th April 2020, some of which will result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

JASMIN Maintenance Tues 21 & 28 April 2020

Tue, 14 Apr 2020 09:29:51 +0000

Scheduled maintenance is planned for Tuesday 21st AND 28th April 2020, some of which will result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

GWS (/gws/nopw/j04/) performance issue

Wed, 08 Apr 2020 16:07:07 +0000

Dear JASMIN users,

We are aware that users are experiencing difficulties with performance and access to some resources on JASMIN at present. This is due to a problem with one of the storage servers.
This will affect the performance of Group Workspaces under the path /gws/nopw/j04 - we believe that small files (<64KB) and symbolic links are more likely to be affected.

JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 5

Wed, 01 Apr 2020 10:28:25 +0000

We are pleased to announce that the two new scientific analysis servers, “ sci1.jasmin.ac.uk ” and “ sci2.jasmin.ac.uk ” are now available with the CentOS7 systems and the new software environments1. These two VMs are available for testing and they are listed in the table of available “sci” servers shown when you log in to any of the login servers. [Please note that the domain name of the new “sci” servers has changed from “ .ceda.ac.uk ” to “ .jasmin.ac.uk ”].

COVID-19 lockdown- impact on CEDA and JASMIN operations

Tue, 24 Mar 2020 12:36:22 +0000

As we are sure you are already aware, the latest government restrictions on travel mean that any issues requiring physical intervention to the JASMIN infrastructure (e.g. a visit to the machine room by a member of the technical team) could now take up to a day or more to resolve. Strict procedures are in place to keep our key members of staff safe whilst they visit the RAL site - but these procedures take time to organise, hence the anticipated delays.

JASMIN2020 abstract deadline extension 16th March

Mon, 09 Mar 2020 14:46:40 +0000

We are pleased to announce that the deadline for abstract submissions to JASMIN2020 has been extended until Monday 16th March at midday. This will be the final hard deadline for oral abstracts, so please don’t delay in submitting your abstracts! All details about submitting can be found here: http://www.jasmin.ac.uk/jasmin2020/

Virtualisation host reboot Friday 7 Feb AM virtual machines affected

Thu, 06 Feb 2020 15:36:05 +0000

The below work has now been completed and all services are back to normal.

An issue has been identified with one of the hypervisors (virtualisation servers) which hosts a number of CEDA and JASMIN virtual machines.

JASMIN Accounts Portal down for maintenance - 5th Feb AM

Tue, 04 Feb 2020 16:09:10 +0000

The JASMIN Accounts Portal will be down from 0800 on 5th February in order to move to a new server. We anticipate only a short downtime.

JASMIN Migration to CentOS7 & LSF replacement with SLURM UPDATE 4

Tue, 04 Feb 2020 13:46:57 +0000

This is the latest update about migrating the JASMIN infrastructure from RedHat Enterprise Linux 6 (RHEL6) to CentOS7 and preparing for the replacement of the LSF batch scheduler with SLURM.

Reboot of jasmin-xfer2, overloading on xfer hosts

Mon, 03 Feb 2020 16:21:00 +0000

We will shortly be rebooting transfer host jasmin-xfer2.ceda.ac.uk to clear problems mainly due to overloading.

We are aware that the current period is proving very busy for the transfer servers, with many users moving data from the RDF to JASMIN. Please bear in mind that these servers are for shared use and that overloading by running multiple transfers at once will have an impact on the usability of the servers and possibly cause disruption for other users. Please be considerate in your use of these machines during this busy period.

Issue with jasmin-login and jasmin-sci* machines - now fixed!

Thu, 23 Jan 2020 13:55:05 +0000

The below issue seemed to be due to a network cable that was causing some problems with the slow jasmin connections. We think the issues have now been fixed.

REMINDER JASMIN systems change freeze - 24/01 to 03/02

Thu, 23 Jan 2020 08:21:21 +0000

There will be a freeze on any changes requested to JASMIN between Friday 24th January and Monday 3rd February. This is due to limited staff availability during this time.

Issue with jasmin-login and jasmin-sci* machines

Tue, 21 Jan 2020 14:45:41 +0000

We are aware of an issue with jasmin-login and jasmin-sci* machines. We are investigating this and are working to resolve it ASAP.

JASMIN systems change freeze - 24/01 to 03/02

Tue, 14 Jan 2020 13:30:00 +0000

There will be a freeze on any changes requested to JASMIN between Friday 24th January and Monday 3rd February. This is due to limited staff availability during this time.

Reminder JASMIN Maintenance Tuesday 14th January 2020

Mon, 13 Jan 2020 09:26:43 +0000

Scheduled maintenance is planned for Tuesday 14th January 2020, which could result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

Reminder JASMIN Maintenance Tuesday 14th January 2020

Mon, 06 Jan 2020 10:03:43 +0000

Scheduled maintenance is planned for Tuesday 14th January 2020, which could result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

Celebrating 25 years of CEDA

Fri, 20 Dec 2019 14:24:49 +0000

The data centre function of CEDA celebrated 25 years of existence in October 2019. As we approach the end of this year, we take a look back to see what has changed along the way.

Advance notice JASMIN maintenance Tues 14 Jan 2020

Thu, 19 Dec 2019 09:40:54 +0000

Scheduled maintenance is planned for Tuesday 14th January 2020, which could result in disruption to JASMIN systems, services and data in addition to the CEDA Archive.

CEDA and JASMIN support over Christmas period

Tue, 17 Dec 2019 10:54:36 +0000

In line with the Christmas shutdown of CEDA’s host institute, STFC, the CEDA and JASMIN teams will be unavailable from 15:00 on Tuesday 24th December 2019 to 09:00 on Thursday 2nd January 2020. However, there will also be minimal helpdesk support before and after this period (from Friday 20th December until Monday 6th January) due to extremely limited staff availability.

Save the date! JASMIN2020 conference dates now announced

Tue, 10 Dec 2019 15:39:25 +0000

Further details will be announced in the New Year - please save the date in the meantime!

REMINDER JASMIN storage maintenance 27th November all services should be considered unavailable

Tue, 19 Nov 2019 09:36:20 +0000

This is another reminder that further scheduled maintenance is required on Wednesday 27th November to supplement the work recently undertaken on 14th October. The work this time will focus mainly on the Panasas system, used for parallel file system (PFS) storage.

Elastic Tape, JDMA, and NLA not available - from 1600 Tuesday, November 26 until Wednesday 27th - at risk Thursday 28th

Tue, 12 Nov 2019 17:12:40 +0000

The databases underlying these systems are being migrated to improved hardware during this period. While the systems are expected to be available along with the rest of JASMIN, there will be an at risk period while the systems are monitored to ensure they behave correctly.

REMINDER JASMIN storage maintenance 27th November all services should be considered unavailable

Tue, 12 Nov 2019 09:53:24 +0000

This is just a reminder that further scheduled maintenance is required on Wednesday 27th November to supplement the work recently undertaken on 14th October. The work this time will focus mainly on the Panasas system, used for parallel file system (PFS) storage.

JASMIN storage maintenance 27th November all services should be considered unavailable

Wed, 06 Nov 2019 14:16:01 +0000

Further scheduled maintenance is required on Wednesday 27th November to supplement the work recently undertaken on 14th October. The work this time will focus mainly on the Panasas system, used for parallel file system (PFS) storage.

Using JASMIN for the largest ever UK wildlife assessment

Thu, 31 Oct 2019 16:24:16 +0000

Most of the UK’s wildlife is in decline, according to the 2019 State of Nature (SoN) report . However getting to this statement was not an easy process. Imagine trying to measure trends across thousands of different species and millions of datapoints, with biases in the data thrown in for added complexity… but that’s exactly what scientists have now done. The most comprehensive SoN report has now been completed with the help of JASMIN - our globally unique petascale analysis facility for data-intensive environmental science. Researchers relying on JASMIN for their data analysis contributed information to the SoN report, including several wildlife groups that had previously been impossible to analyse.

JASMIN Migration to CentOS7 UPDATE 2

Mon, 28 Oct 2019 14:07:44 +0000

This is the second update about our progress towards updating our infrastructure from RedHat Enterprise Linux 6 (RHEL6) to CentOS7.

JASMIN External Cloud Tenancies Network change today

Thu, 24 Oct 2019 09:40:52 +0000

A network change that will affect a number of virtual machines in External Cloud tenancies is scheduled for today, October 24. If your VMs are going to be affected, you have been already notified about the potential disruption, and you need to take no further action. The disruption will happen in an ad-hoc manner during the day and it will last an expected maximum of 5 minutes per case.

JASMIN & CEDA Services at risk Wednesday 30th Oct

Wed, 23 Oct 2019 09:58:09 +0000

We have been informed that due to electrical work associated with construction in the vicinity of the building in which JASMIN is hosted, there is a low level of risk that power supplies could be affected on this date.

Migration of JASMIN virtual machines - how will this affect you?

Tue, 01 Oct 2019 12:05:49 +0000

RHEL6 virtual machines to be migrated to CentOS7
Currently, many CEDA and JASMIN services are hosted using virtual machines (VMs) which run on RedHat Enterprise Linux 6 (RHEL6). These will soon need to be migrated to VMs based on the CentOS7 operating system. This is because:

Reminder system maintenance Today 15 October 2019

Thu, 19 Sep 2019 12:48:22 +0000

Scheduled maintenance is planned for Tuesday 15th October, which will result in many systems, services and data (including parts of the CEDA Archive) being unavailable for much of the day. We apologise for any inconvenience this may cause.