National Data centres an example to us all?

September 6th, 2011 by johnm

Technopolis recently published a report sponsored by JISC and RIN http://www.jisc.ac.uk/publications/generalpublications/2011/09/datacentres.aspx on the impact of research data centres in the UK.

The report shows that researchers seem to be generally pretty positive about the benefits of data centres as a focus for data management and sharing. 

The report goes on to suggest that data centres are often good centres of expertise in the ingest and ongoing management of data and that some researchers recognise the value of such services especially when focussed on specialist areas of direct relevance to the researchers work.

The big question remains though. What do we do about data that established data centres don’t want as there’s a lot of it.

I’m of the view that the data centres must ultimately be part of a sort of data management “ecosystem” and that the DCC has a key role in establishing that and not just in the UK either.

Our goal must be to have all researchers equipped with the expertise and efficient infrastructure to work with data so that it is properly managed and sensibly stored throughout its life cycle. Data centres and their specialist staff are an important part of that story for many subject areas, but they are only a part.  Moreover the advent of Cloud technology and the consequent growth of massive commercial infrastructure will inevitably change the economics of the underlying ICT infrastructure and so maybe they’ll have to reinvent themselves and develop new kinds of relationships too.

It all goes to show that data management is a critical aspect of modern research whatever the discipline and that there’s a lot of work to do before we see professional standards of data management with coherent tools in an efficient infrastructure across the spectrum of academic disciplines.

Scudding Clouds!

August 30th, 2011 by johnm

Three articles fom the Register grabbed my attention this morning.

http://www.theregister.co.uk/2011/08/29/dell_vmware_infrastructure_cloud/

http://www.theregister.co.uk/2011/08/29/vmware_vcloud_connector_update/

http://www.theregister.co.uk/2011/08/29/citrix_cloud_com_update/

They all highlight the rapid development of Cloud services and the big players in the IT industry looking to to ensure that their businesses evolve to protect their revenues.

As always there’s an open source component to the story, but the telling fact is that to be a Cloud services provider you need the financial muscle to deploy at enormous scale. On the other hand to provide such suppliers with the tools they need you must be innovative and reliability and quality conscious, but not necessarily big!

I’m increasingly convinced that there’s no longer a case for HE institutions to operate data centres. Even where these are shared amongst groups they go nowhere near the scale of the major commercial/industrial providers and so can’t compete in the cost effectiveness and carbon emission stakes. So even where institutions are not ready to use Cloud, co-location in a commercial data centre, leading to virtualisation and then Cloud deployment of their services is looking to be a compelling strategy. As Phil Richards at Loughborough has pointed out, the fact that we have JANET and can attach these data centres as in the Logicalis case makes the argument almost unassailable now.

The data challenge that drives us all

August 22nd, 2011 by johnm

This report on the excellent DCC roadshows http://www.ariadne.ac.uk/issue67/dcc-2011-03-rpt/ reminded me again of why we’re doing all this.

It became clear from the UKRDS study that DCC was a key source of data management expertise and the JISC MRD programme was highlighting a range of solid practical issues.

The UMF is now attempting to build on that by creating a sustainable supported infrastructure that will allow institutions to respond to the challenge of the data deluge effectively.

The scale of the problem is such that individual institutions simply cannot hope to cope alone. The sector must act collectively to acquire services that are affordable and the evidence is growing that commercial Cloud based services tailored to sector needs may not just be a good answer, they may be the only viable answer!

Procurement a ball and chain on value?

August 19th, 2011 by johnm

OJEU procurement has been a frustration for me over many years, both as a buyer and as a supplier. However I don’t think it needs to be that way.

Far too many procurement projects become obsessed with process and spec compliance and fail to focus on “what it’s for” rather than “what it is”.

This is frustrating for suppliers, who are constrained by spec compliance and find it difficult to add value through offering their skills and expertise in creative ways to address the customer problem.

It’s frustrating for users who have wait long periods before acquiring the products and services they need simply to meet arbitrary timescales imposed by processes.

However there are ways to improve this. It just requires people to leave doors open rather than shut when writing specs and to look for innovative ways to use processes like Dynamic Purchasing Systems.

Thanks to help from HEFCE procurement UMF is working hard to ensure that the procurement process is an aid to clarity and simplicity in buying for both suppliers and customers, while maintaining high levels of probity and due diligence. Procurement doesn’t have to be a bureaucratic ball and chain!

DCC

August 12th, 2011 by johnm

A tweet by Simon Hodson reminded me that that there is a DCC roadshow in Oxford 14th to 16th September you can register here http://www.dcc.ac.uk/events/data-management-roadshows/dcc-roadshow-oxford  and if you can’t claim to be an expert and carry some responsibility for policy or practical aspects of research data management, then you should.

For some reason it isn’t well know outside the specialist communities of data scientists and the like  that DCC are world leaders in this field (unsung heroes if you like!).  Their work has been adopted by the NSF in the USA and by ANDS the Australian National Data Service  who themselves are major players in the field.

The UMF programme acting on the recommendations of the UKRDS report (www.ukrds.ac.uk) has funded DCC to accelerate the deployment of its tools and training programme as that is seen as key to the effective exploitation of data management in the cloud.

Please involve DCC in any work you might be doing on research data management, you’ll be glad you did!

Shared services and ERG

August 9th, 2011 by johnm

http://tinyurl.com/3hofpmb provides an interesting insight into apparent Cabinet Office thinking on the shared services agenda. I think those of us working on UMF would claim to be seeking ways to follow the principles outlined.

It seems to me however that there is a sense that HMG makes some slightly simplistic assumptions. The hardest part of establishing true shared services is using common systems and business processes and that’s not a trivial thing to achieve and can take a long time.

In HE we have some unique opportunities because of the scale of activity in research which can use common compute and storage infrastructure, moreover much of it can be virtualised and there are a number of key areas where common applications can be used and delivered though SaaS. There are analogous opportunities in Learning and teaching too.

If we are successful we will have been able to demonstrate all of the above in live service by March 2012 and we will have opened the shared environment to administrative applications too.

Many of our suppliers are beginning to see the power in Cloud delivery of their products and with their active co-operation and some innovative team work HE is poised to become a major demonstration of the power of shared services both to save money at the infrastructure level and to add value at the application and data management level.

Of course shared services in HE is not new JANET, Jisc Collections UKDA and a number of examples in the Library community will spring to mind and so we have no excuse, we know how to co-operate and that’s what shared services is all about.

UMF Progress

August 6th, 2011 by johnm

I’m now going to try and use the blog to keep a regular diary of issues and progress.

While it has taken a frustratingly long time to get there,  all of the components of UMF Strand A are now in place and moving forward. The DCC programme of tools and training is in place, over 400 users of DMP on-line have produced over 500 data management plans in support of research projects and grant applicaions and its workshop programme is spreading the word on Data Management good practice across the UK.  The JANET brokerage is developing fast as resources drop into place and we’re getting some very positive customer and supplier engagement.

A major concern has been the potential complexity of procurement processes in the context of Cloud services. Traditional approaches simply don’t work in IT any more. By the time you’ve written the spec, gone out to tender, got responses and evaluated them, what you were trying to buy has become obsolete!

We are moving to models where we look for outcome or output specs which explain to potential suppliers WHAT we want to do and let them suggest HOW their products and services can help us achieve that. As a result we should be able to get close to buying standard products which is good for us and easier for suppliers.

Amazing as it may seem the EU procurement framework has a process to help with this and it’s called Dynamic Purchasing Systems and we’re about to try it out to get some Cloud services into the JANET portfolio for the sector to use. there’ll be more on our experiences with that in the next few weeks (commercial confidentiality permitting he says ruefully).

A key plank of our work will be developing communications infrastructure within institutions so that researchers seeking to buy IT infrastructure will slowly learn that by engaging with their central  IT support folks, they’ll be able to get servers and storage configured in hours if they have the money, rather than having to go out and buy kit and licences which can take weeks. Moreover they might be able to get a data management and compute application  to use and not even need to deal with the infrastructure at all.

Over the next few months we expect to start to see case studies on this and to present them at conferences too. In the meantime if you want to know how we plan to achieve these miracles get in touch at j.milner@jisc.ac.uk

UMF commences

August 5th, 2011 by johnm

On the 20th January the HEFCE Advisory Board agreed to launch the programme to develop a shared services infrastructure for HEIs.
This is quite a momentous decision as it paves the way for a HE cloud in due course. The initial focus will be on establishing a service delivery co-ordination capability by developing the JANET (UK) organisation and setting up a pilot infrastructure. The successful Digital Curation Centre will be funded to develop its capability to support researchers in coherent data management in the shared environment.

All in all I think we’re now started on a journey of great significance to quality of digital research in the UK.

Cloud Share services blog

January 17th, 2011 by johnm

If all goes according to plan, this will be the home of a blog on shared services and cloud applications for UK based researchers, just need the funding agreed…….