Storage: Difference between revisions

From OpenCompute
Jump to navigation Jump to search
No edit summary
(72 intermediate revisions by 3 users not shown)
Line 1: Line 1:
= OCP Storage  =
==Welcome==


Chair: [mailto:jorge.campello@ocproject.net Jorge Campello]
:Welcome to the OCP Storage Project.
 
This Project is open to the public and we welcome all those who would like to be involved.
 
Disclaimer: Please do not submit any confidential information to the Project Community. All presentation materials, proposals, meeting minutes and/or supporting documents are published by OCP and are open to the public in accordance to OCP's Bylaws and IP Policy. This can be found on the OCP [http://www.opencompute.org/participate/legal-documents/ Legal Docs] page.  If you have any questions please contact OCP.


== Mission Statement ==


The OCP Storage committee focuses on creating specifications and Software that drive open innovation in hardware to enable new storage applications and provide users greater efficiency and value.
The OCP Storage committee focuses on creating specifications and Software that drive open innovation in hardware to enable new storage applications and provide users greater efficiency and value.


== Storage Charter ==
==Documents==
 
:-  [http://files.opencompute.org/oc/public.php?service=files&t=26d8213816ef2ff0195b48f2765c5f5e Charter]
 
==Project Leadership==
 
'''Incubation Committee Representative'''
:- [mailto:doug.bone@ocproject.net Doug Bone] (Hyve Solutions)
 
'''Project Lead'''
:- [mailto:jorge.campello@ocproject.net Jorge Campello] (Western Digital)
 
==Get Involved==


The OCP Storage Project Charter version 1.2 can be found [http://files.opencompute.org/oc/public.php?service=files&t=26d8213816ef2ff0195b48f2765c5f5e here].
:- [Mailing List]
:- [OCP website]
:- [http://opencompute.org/projects/projects-calendar/ OCP Calendar]


== Monthly Project Meetings (online) ==
==Regular Project Calls==


The 2nd Thursday of every month rotating at 9 AM Pacific (ie 10 AM Mountain, 11 AM Central, 12 PM Eastern) AND 4 PM Pacific (ie 5 PM Mountain, 6 PM Central, 7 PM Eastern)
This project meets on the second Thursday of every month rotating between 9am PT and 4pm PT (please check the project calendar)
:- [https://attendee.gotowebinar.com/register/4800086622601834753 Registration URL]
:- Webinar ID: 30636806
:- [https://docs.google.com/document/d/1feUimOJR4P-ajwk8xZ18ksnuYgcLKa3Dm4JVY6YAqOQ/edit?usp=sharing Agenda]


===Upcoming Call (Open to the public) ===
==Recordings from Past Calls==


{| class="wikitable"
:- [http://files.opencompute.org/oc/public.php?service=files&t=3775500d80e471d8e086d37ab5477ad0 Mar 8th, 2018]
|-
:- [http://files.opencompute.org/oc/public.php?service=files&t=162f73a710746b0df7f44f3afb75fb5b Feb 8th, 2018]
! Subject
:- [http://files.opencompute.org/oc/public.php?service=files&t=40d7254656a0e6fc1d3933f1bbe906df Jan 11th, 2018]
! Date
:- [http://files.opencompute.org/oc/public.php?service=files&t=c7f4665d5f61846cd8e0d09fb486e257 Dec 14th, 2018]
! Start Time
! End Time
! Meeting ID
! Meeting URL
! Toll Free Number
! Toll Number
! International Access Numbers
! Agenda
! Notes
|-
| OCP Storage Monthly Call
| Thursday, December 15, 2016
| 4:00 PM PDT
| 5:00 PM PDT
| 30636806
| [https://www.fuzemeeting.com/fuze/76a85d4f/30636806 Fuze Meeting]
| +1-855-346-3893
| +1-201-479-4595
| [https://www.fuze.com/extras/symphony Fuze Internation Numbers]
| [http://pad.opencompute.org:9001/p/Storage_Call_15_December_2016 Click Here]
| Just a reminder that this call will be recorded and shared in the meeting notes
|}


== Meeting Notes from Previous Storage Monthly Calls  ==
== Meeting Notes from Previous Storage Monthly Calls  ==
Line 50: Line 48:
== Storage - Sub Projects ==
== Storage - Sub Projects ==


 
* [http://www.opencompute.org/wiki/Health_Chain_Management Health Chain Management]
* [http://www.opencompute.org/wiki/Wear_Monitor Open Wear Monitor]


== Specs, Designs and Presentations ==
== Specs, Designs and Presentations ==
Line 58: Line 55:


===Accepted Projects===
===Accepted Projects===


{| class="wikitable"
{| class="wikitable"
Line 68: Line 64:
! Notes
! Notes
! License
! License
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=eddcffbce54dba60f72bcf0721ffe6b4 Open_Compute_Project_Bryce Canyon_Specification_v0.7]
| v0.7
|Mar. 8, 2017
| Facebook
|
| OWFa 1.0
|-
|-
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=5dc72e32ba081baf0a8a99b46183888c Open_Compute_Project_Honey_Badger_Specification_v0.8_for_IC]
| [http://files.opencompute.org/oc/public.php?service=files&t=5dc72e32ba081baf0a8a99b46183888c Open_Compute_Project_Honey_Badger_Specification_v0.8_for_IC]
Line 74: Line 78:
| Facebook
| Facebook
|
|
| OWFa 1.0
|  
|-
|-
|-
|-
Line 169: Line 173:
! License
! License
|-
|-
-
| [http://files.opencompute.org/oc/public.php?service=files&t=3e3bb43816addd2955a2aab309291ee3 Lightning Design Files]
| v1.0
| January 11, 2018
| Wiwynn
| Currently under the community review
|
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=ff9615864f33731e50c21a33f2656dc8&download Bryce Canyon Design Files]
| v1.0
| January 11, 2018
| Wiwynn
| Currently under the community review
|
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=e33d133598b3847ab01f3f91608e24ae Lightning Specification]
| v1.0
| January 11, 2018
| Facebook
| Currently under the community review
| OCPHL Permissive
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=ff9615864f33731e50c21a33f2656dc8 Bryce Canyon Specification]
| v1.00
| March 7th, 2018
| Facebook
| Currently under the community review
| OCPHL Permissive
|-
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=35d787b63af6b5f2c9da9a0e0faebcd3  OCP C&I Storage Certification Specification and Test Plan]
| [http://files.opencompute.org/oc/public.php?service=files&t=35d787b63af6b5f2c9da9a0e0faebcd3  OCP C&I Storage Certification Specification and Test Plan]
Line 189: Line 221:
| Currently under the community review
| Currently under the community review
| OWFa 1.0
| OWFa 1.0
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=0a8171316553b011eaaa3f6ae09c4faf  Open Vault SAS6G Storage ]
| v1.0
| November 9, 2016
| Wiwynn
| Currently under the community review
|
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=98415a68635351c1d79807168e149128 Open Vault SAS12G Storage ]
| v1.0
| November 9, 2016
| Wiwynn
| Currently under the community review
|
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=30c20e7d311e75b52f9a789ee6702fbb AF-Media ]
| v0.2
| August 26, 2016
| SK Telecom
| Currently under the community review
|
|}
|}


Line 222: Line 275:
| Facebook
| Facebook
| Currently under the IC review                   
| Currently under the IC review                   
|}
===Cloud HDD===
This section contains all the documents related to the Cloud-optimized HDD activity.
{| class="wikitable"
|-
! Process Document
! Version
! Submit Date
! Contributor
! Notes 
! License/Agreement
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=bb777616f35ca76bb1deef69d6521308 Cloud-optimized HDD API Standardization Process in OCP]
| v1.2
| July 21, 2017
| Google, Microsoft, Facebook
| IC Approved 
| NA
|-
|}
{| class="wikitable"
|-
! Project Proposal
! Version
! Submit Date
! Contributor
! Notes 
! License/Agreement
|-
| [https://docs.google.com/document/d/10y-IrfsiuS4071iScA-PgcQWdyQTiLSapnnfQ39o5_I/edit Host-Managed Fast-Fail Read Proposal  ]
| v0.1
| February 9, 2017
| Google
| Agreement Signature required for participation.
| [https://rightsignature.com/forms/OCP-Joint-Specifi-a28ca5/token/6194ee31c19 Joint Development Agreement]             
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=50192ac3fff6f7d96c314dc39cd92f26 Hybrid-SMR Product Requirements Proposal  ]
| v0.1
| November 13, 2017
| Google
| New proposal
| [TBD]
|}
{| class="wikitable"
|-
! Other Contributions
! Submit Date
! Contributor
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=8e36f9053b8723a254725a2b58a78951 Flex Proposal  ]
| December 11, 2017
| Seagate
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=f4909b8a22290aaf1976a5b131f17ded Realms API Proposal  ]
| October 31, 2017
| Western Digital
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=f426e6f99f733acc24cd9e2ebfd2de3e Flex Device Interface  ]
| January 4, 2018
| Seagate
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=0624c2c23c28c622b98e15137bbf1f5f Dynamic Hybrid Shingled Magnetic Recording (DHSMR) Concept Description  ]
| January 19, 2018
| Western Digital
|}
|}


Line 234: Line 361:
! OCP Candidate (Yes/No)
! OCP Candidate (Yes/No)
|-
|-
| '''OCP Storage Monthly Call, Online, August 11, 2016'''
 
| '''OCP Storage Monthly Call, Online, January 11, 2018'''
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=ecbe59158515b70e04228bc170130172 Lightning Spec Update Overview]
| Clark Shao
| January 11, 2018
| Facebook
| NA
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=6d741e635cebd382e095b5c46e2c5b7a Bryce Canyon Spec Update Overview]
| Madhavan Ravi
| January 11, 2018
| Facebook
| NA
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=56fa4216609f441d327c33cc80650400 Wiwynn Bryce Canyon & Lightning Design Contribution Overview]
| Bing Wu
| January 11, 2018
| Wiwynn
| NA
|-
| '''OCP Storage Monthly Call, Online, April 13, 2017'''
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=3264acd444e6915e675dc8dff072a05c Request for T13 Resources]
| Jim Hatfield
| April 13, 2017
| Seagate
| NA
|-
| '''OCP Storage Monthly Call, Online, February 9, 2017'''
|-
| [https://docs.google.com/document/d/155v8Zo2hD1VaZk0yTbXbIiJ7g2spusjDaEhp43WQY6k/edit Cloud-optimized HDD API Standardization Process ]
| Lawrence Ying
| February 9, 2017
| Google
| NA
|-
|-
| [https://docs.google.com/document/d/10y-IrfsiuS4071iScA-PgcQWdyQTiLSapnnfQ39o5_I/edit Host-Managed Fast-Fail Read Proposal  ]
| Lawrence Ying
| February 9, 2017
| Google
| NA
|-
|-
| ''''''OCP Storage Monthly Call, Online, August 11, 2016''''''
|-
|-
| [http://files.opencompute.org/oc/public.php?service=files&t=413017da9b35b43d6d526bd6d063e6c0 Health Chain Management  ]
| [http://files.opencompute.org/oc/public.php?service=files&t=413017da9b35b43d6d526bd6d063e6c0 Health Chain Management  ]
Line 504: Line 676:
|-  
|-  
|}
|}
== Meetups ==
* [http://www.meetup.com/Open-Compute-Project/  Link to the OCP meetup.com site]
== Regional Engineering Summit ==
* [http://www.opencompute.org/community/events/  Link to the OCP Events and Calendar]

Revision as of 17:33, 9 March 2018

Welcome

Welcome to the OCP Storage Project.

This Project is open to the public and we welcome all those who would like to be involved.

Disclaimer: Please do not submit any confidential information to the Project Community. All presentation materials, proposals, meeting minutes and/or supporting documents are published by OCP and are open to the public in accordance to OCP's Bylaws and IP Policy. This can be found on the OCP Legal Docs page. If you have any questions please contact OCP.


The OCP Storage committee focuses on creating specifications and Software that drive open innovation in hardware to enable new storage applications and provide users greater efficiency and value.

Documents

- Charter

Project Leadership

Incubation Committee Representative

- Doug Bone (Hyve Solutions)

Project Lead

- Jorge Campello (Western Digital)

Get Involved

- [Mailing List]
- [OCP website]
- OCP Calendar

Regular Project Calls

This project meets on the second Thursday of every month rotating between 9am PT and 4pm PT (please check the project calendar)

- Registration URL
- Webinar ID: 30636806
- Agenda

Recordings from Past Calls

- Mar 8th, 2018
- Feb 8th, 2018
- Jan 11th, 2018
- Dec 14th, 2018

Meeting Notes from Previous Storage Monthly Calls

Storage - Sub Projects

Specs, Designs and Presentations

A template specification is located here with example chapters and tables. Be sure to ensure that you've got the correct license in place according to your company's submission policies.

Accepted Projects

Specification Version Submit Date Contributor Notes License
Open_Compute_Project_Bryce Canyon_Specification_v0.7 v0.7 Mar. 8, 2017 Facebook OWFa 1.0
Open_Compute_Project_Honey_Badger_Specification_v0.8_for_IC v0.8 Jan. 8, 2015 Facebook
Open_Compute_Project_Panther+_Specification_v0.8_for_IC v0.8 Jan. 8, 2015 Facebook OWFa 1.0
Honey Badger Panther Plus Schematic Design v1B Jan. 20, 2015 Wiwynn
Honey Badger Baseboard Schematic Design v1B Jan. 20, 2015 Wiwynn
Honey Badger Electrical Design - March 5, 2015 Wiwynn
Honey Badger Mechanical Design - March 5, 2015 Wiwynn
Storage device with Ethernet Interface v 4 November 6, 2014 Seagate Technology OWFa 1.0
Single port T-Card for storage device with Ethernet interface v 2 August 21, 2014 Seagate Technology OWFa 1.0
Example of Open Storage Ethernet Device Implementation v 3 August 20, 2014 Seagate Technology
Single_Port_T-Card_files v 1 Jan 13, 2014 Seagate Technology Not Stated
Decathlete Server Board Standard v1 (PDF) v2.0 May 31, 2013 Intel Version Independent OWFa 1.0
Open Vault Storage Hardware V0.8 OR-draco-bueana-0.8 (PDF) v0.8 April 16. 2014 Facebook OWFa 1.0
Cold Storage Hardware v0.7 ST-draco-abraxas-0.7 (PDF) v0.7 April 16. 2014 Facebook OWFa 1.0

Storage Committee Review

-
Specification Version Submit Date Contributor Notes License
Lightning Design Files v1.0 January 11, 2018 Wiwynn Currently under the community review
Bryce Canyon Design Files v1.0 January 11, 2018 Wiwynn Currently under the community review
Lightning Specification v1.0 January 11, 2018 Facebook Currently under the community review OCPHL Permissive
Bryce Canyon Specification v1.00 March 7th, 2018 Facebook Currently under the community review OCPHL Permissive
OCP C&I Storage Certification Specification and Test Plan v0.14 November 5, 2014 OCP C&I Currently under the community review OWFa 1.0
OCP Storage Charter v1.0 December 6, 2015 OCP Storage Currently under the community review
Lightning Hardware System Specification v0.15 February 8, 2016 Facebook Currently under the community review OWFa 1.0
Open Vault SAS6G Storage v1.0 November 9, 2016 Wiwynn Currently under the community review
Open Vault SAS12G Storage v1.0 November 9, 2016 Wiwynn Currently under the community review
AF-Media v0.2 August 26, 2016 SK Telecom Currently under the community review

IC Review

This section contains all the document currently approved by the Storage committee and sent to Incubation Committee for their review.

Specification Version Submit Date Contributor Notes License
Open Vault Storage SAS Expander Firmware Specification v1.0 October 30, 2015 Wiwynn Currently under the IC review OWFa 1.0
MF1_V03-001_2015_01_22_2030 v0.51 Jan. 22, 2015 Quanta Currently under the IC review
Requirements agreed with ODMs N/A Jan. 20, 2015 Facebook Currently under the IC review


Cloud HDD

This section contains all the documents related to the Cloud-optimized HDD activity.

Process Document Version Submit Date Contributor Notes License/Agreement
Cloud-optimized HDD API Standardization Process in OCP v1.2 July 21, 2017 Google, Microsoft, Facebook IC Approved NA


Project Proposal Version Submit Date Contributor Notes License/Agreement
Host-Managed Fast-Fail Read Proposal v0.1 February 9, 2017 Google Agreement Signature required for participation. Joint Development Agreement
Hybrid-SMR Product Requirements Proposal v0.1 November 13, 2017 Google New proposal [TBD]


Other Contributions Submit Date Contributor


Flex Proposal December 11, 2017 Seagate
Realms API Proposal October 31, 2017 Western Digital
Flex Device Interface January 4, 2018 Seagate
Dynamic Hybrid Shingled Magnetic Recording (DHSMR) Concept Description January 19, 2018 Western Digital

Storage Presentations

Title Speaker Date Contributor OCP Candidate (Yes/No)
OCP Storage Monthly Call, Online, January 11, 2018
Lightning Spec Update Overview Clark Shao January 11, 2018 Facebook NA
Bryce Canyon Spec Update Overview Madhavan Ravi January 11, 2018 Facebook NA
Wiwynn Bryce Canyon & Lightning Design Contribution Overview Bing Wu January 11, 2018 Wiwynn NA
OCP Storage Monthly Call, Online, April 13, 2017
Request for T13 Resources Jim Hatfield April 13, 2017 Seagate NA
OCP Storage Monthly Call, Online, February 9, 2017
Cloud-optimized HDD API Standardization Process Lawrence Ying February 9, 2017 Google NA
Host-Managed Fast-Fail Read Proposal Lawrence Ying February 9, 2017 Google NA
'OCP Storage Monthly Call, Online, August 11, 2016'
Health Chain Management Stephen O’Mahony & Jun Liu August 11, 2016 Apple, Seagate Yes
Open CloudServer-vNext Generation Mark Shaw August 11, 2016 Microsoft Yes
OCP Storage Monthly Call, Online, July 14, 2016
Data Center Storage Task Force Mark Carlson July 14, 2016 SNIA No
OCP Engineering Workshop at Quanta, San Jose, June 2, 2016
Introduction to Ceph Jacob Shucart June 2, 2016 Red Hat Inc. No
Adding Analytical Intelligence to the Block Storage Layer Andy Mills June 2, 2016 Enmotus No
OCP Summit San Jose, March 10, 2016
OpenMonitor, Wear Leveling Across Data Centers Mark Carlson March 10, 2016 Storage Subgroup Yes
Lightning: A Flexible NVMe JBOF Chris Petersen March 10, 2016 Facebook Yes
SCube AF-Media, High Density/High Efficient All-Flash Storage Server Jungsoo Kim March 10, 2016 SKT Yes
Disks for Data Center in the era of Cloud-based storage Lawrence Ying March 10, 2016 Google Yes
OCP Summit San Jose, March 10, 2015
Health monitoring & predictive analytics Christian B. Madsen & Andrei Khurshudov March 10, 2015 Seagate Technology No
Honey Badger and Panther+ Mike Yan March 10, 2015 Facebook Yes
S5,the ALL-FLASH Software Defined Storage for CLOUD Vince Zhou March 10, 2015 NetBRIC Technology Yes
“Igloo” Cold Storage Concept Rob Ryan March 10, 2015 WD Labs No
OCP Summit San Jose, March 11, 2015
SMR, The Future of Cheap and Deep Paul Renden March 11, 2015 Seagate Technology No
Optimal Methods for Handling Our Precious Data Amit Chattopadhyay March 11, 2015 WD No
OCP Engineering Workshop San Jose, March 9, 2015
State of The Storage Asghar Riahi March 9, 2015 OCP Storage Chair/Seagate Technology No
Leveraging Ceph on Next Gen Storage Jamon Bowen March 9, 2015 Seagate Technology No
HatTrick High Density OCP Storage Solution Howard Cohen March 9, 2015 StackVelocity Yes
Object Drives, A New Architectural Positioning? Mark Carlson March 9, 2015 SNIA/Toshiba No
Seagate Kinetic Open Storage Platform David Burks & Mayur Shetty March 9, 2015 Seagate Technology No
Architecting Highly Efficient Web-scale Cold Storage for Unstructured Data Mark Goros & Jie Yu March 9, 2015 Caringo / WD No
Storage & Certification Joint Session Asghar Riahi & Thao Nguyen & YF & Paul Rad March 9, 2015 Seagate,Facebook, ITRI, UTSA No
Evolving from Appliance Switched Fabrics to Device Switched Fabrics Dimitar Boyn March 9, 2015 ioSwitch No
SMR Directions: Data Center Applications Jim Malina & Albert Chen March 9, 2015 WD No
OCP European Summit, Paris, October 30 & 31, 2014
State of the Storage Asghar Riahi October 30, 2014 OCP Storage Committee Report No
Which OCP Storage is right for you? Adam Tarnowski October 30, 2014 Hyve Solutions No
Object Drives - A New Architectural Positioning? Mark Carlson October 30, 2014 Toshiba No
SMR Directions: Data Center Applications Jim Malina October 30, 2014 Western Digital No
The Future of Cheap & Deep Philippe Vaillant October 30, 2014 Seagate Technology No
SMR, the ZBC/ZAC Standards and the New libzbc Open Source Project Jorge Campello October 30, 2014 HGST No
Capacity to Bigfoot Lead with Kinetic and Rausch Joe Fagan & Sebastian Noelting October 31, 2014 Seagate Technology & Rausch No
Previous Storage Presentations
Micro Server in Open Vault Storage Mike Yan Jan 28, 2014 Facebook Yes
Dramatic Improvement in Storage Performance by Implementing Vibration Protection Rack Gus Malek-Madani Jan 28, 2014 Green Platform Corporation No
Archive & Cold Storage Device Trends Jun Liu & Josh Tinker Jan 28, 2014 Seagate Technology No
Flash for the Future Nisha Talagala & Gary Orenstein Jan 28, 2014 Fusion-io No
Rack Storage for Cloud Applications Manoj Wadekar Jan 28, 2014 QLogic Corp. No
Kinetic Open Storage Platform James Hughes Jan 28, 2014 Seagate Technology No
SMR Host Managed Albert Chen &

Jim Malina

Jan 28, 2014 Western Digital Corporation No
Chassis Design Best Practices to Optimize Hard Drive I/O Performance Richard N Repp May 8, 2014 Seagate Technology No
Cloud Storage Challenges and Opportunities Dimitar Boyn May 8, 2014 ioSwitch No
SMR Zoned Block Device Overview Timothy Feldman July 21, 2014 Seagate Technology No