EP2883170A4 - Archival data storage system - Google Patents

Archival data storage system

Info

Publication number
EP2883170A4
EP2883170A4 EP13828257.9A EP13828257A EP2883170A4 EP 2883170 A4 EP2883170 A4 EP 2883170A4 EP 13828257 A EP13828257 A EP 13828257A EP 2883170 A4 EP2883170 A4 EP 2883170A4
Authority
EP
European Patent Office
Prior art keywords
data storage
storage system
archival data
archival
storage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13828257.9A
Other languages
German (de)
French (fr)
Other versions
EP2883170A2 (en
Inventor
Kestutis Patiejunas
Colin L Lazier
Mark C Seigle
James R Hamilton
Alyssa H Henry
Bryan J Donlan
Christian L Claiborn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Amazon Technologies Inc
Original Assignee
Amazon Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/570,088 external-priority patent/US9767098B2/en
Priority claimed from US13/570,151 external-priority patent/US8805793B2/en
Priority claimed from US13/569,591 external-priority patent/US9354683B2/en
Application filed by Amazon Technologies Inc filed Critical Amazon Technologies Inc
Priority to EP20197244.5A priority Critical patent/EP3805941B1/en
Publication of EP2883170A2 publication Critical patent/EP2883170A2/en
Publication of EP2883170A4 publication Critical patent/EP2883170A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/90335—Query processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/113—Details of archiving
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/14—Details of searching files based on file metadata
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/174—Redundancy elimination performed by the file system
    • G06F16/1744—Redundancy elimination performed by the file system using compression, e.g. sparse files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/185—Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601—Interfaces specially adapted for storage systems
    • G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0638—Organizing or formatting or addressing of data
    • G06F3/0644—Management of space entities, e.g. partitions, extents, pools

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Library & Information Science (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • User Interface Of Digital Computer (AREA)
EP13828257.9A 2012-08-08 2013-08-06 Archival data storage system Withdrawn EP2883170A4 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP20197244.5A EP3805941B1 (en) 2012-08-08 2013-08-06 Archival data storage system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US13/570,088 US9767098B2 (en) 2012-08-08 2012-08-08 Archival data storage system
US13/570,151 US8805793B2 (en) 2012-08-08 2012-08-08 Data storage integrity validation
US13/569,591 US9354683B2 (en) 2012-08-08 2012-08-08 Data storage power management
PCT/US2013/053852 WO2014025820A2 (en) 2012-08-08 2013-08-06 Archival data storage system

Related Child Applications (1)

Application Number Title Priority Date Filing Date
EP20197244.5A Division EP3805941B1 (en) 2012-08-08 2013-08-06 Archival data storage system

Publications (2)

Publication Number Publication Date
EP2883170A2 EP2883170A2 (en) 2015-06-17
EP2883170A4 true EP2883170A4 (en) 2015-07-29

Family

ID=50068694

Family Applications (2)

Application Number Title Priority Date Filing Date
EP13828257.9A Withdrawn EP2883170A4 (en) 2012-08-08 2013-08-06 Archival data storage system
EP20197244.5A Active EP3805941B1 (en) 2012-08-08 2013-08-06 Archival data storage system

Family Applications After (1)

Application Number Title Priority Date Filing Date
EP20197244.5A Active EP3805941B1 (en) 2012-08-08 2013-08-06 Archival data storage system

Country Status (9)

Country Link
EP (2) EP2883170A4 (en)
JP (2) JP6165862B2 (en)
KR (3) KR101766214B1 (en)
CN (1) CN104603776B (en)
AU (3) AU2013299731A1 (en)
BR (1) BR112015002837A2 (en)
CA (1) CA2881567C (en)
SG (2) SG11201500836QA (en)
WO (1) WO2014025820A2 (en)

Families Citing this family (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11093327B1 (en) * 2012-06-25 2021-08-17 Pure Storage, Inc. Failure abatement approach for failed storage units common to multiple vaults
WO2015175720A1 (en) * 2014-05-13 2015-11-19 Netapp, Inc. Storage operations utilizing a multiple-data-storage-devices cartridge
US9430321B2 (en) 2014-05-13 2016-08-30 Netapp, Inc. Reconstructing data stored across archival data storage devices
US9766677B2 (en) 2014-05-13 2017-09-19 Netapp, Inc. Cascading startup power draws of enclosures across a network
US9557938B2 (en) 2014-05-13 2017-01-31 Netapp, Inc. Data retrieval based on storage device activation schedules
US9430152B2 (en) 2014-05-13 2016-08-30 Netapp, Inc. Data device grouping across data storage device enclosures for synchronized data maintenance
US9424156B2 (en) 2014-05-13 2016-08-23 Netapp, Inc. Identifying a potential failure event for a data storage device
US9430149B2 (en) 2014-05-13 2016-08-30 Netapp, Inc. Pipeline planning for low latency storage system
US9436524B2 (en) 2014-05-13 2016-09-06 Netapp, Inc. Managing archival storage
US9436571B2 (en) 2014-05-13 2016-09-06 Netapp, Inc. Estimating data storage device lifespan
US9836234B2 (en) 2014-06-04 2017-12-05 Pure Storage, Inc. Storage cluster
US10574754B1 (en) 2014-06-04 2020-02-25 Pure Storage, Inc. Multi-chassis array with multi-level load balancing
US9213485B1 (en) 2014-06-04 2015-12-15 Pure Storage, Inc. Storage system architecture
CN106294503B (en) * 2015-06-09 2019-09-20 阿里巴巴集团控股有限公司 Dynamic storage method, device and the calculating equipment of data
US10496280B2 (en) * 2015-09-25 2019-12-03 Seagate Technology Llc Compression sampling in tiered storage
KR102347887B1 (en) * 2015-10-30 2022-01-05 삼성에스디에스 주식회사 Method and apparatus for managing timeline using search engine
CN106886539B (en) * 2015-12-16 2023-11-24 泰康保险集团股份有限公司 Data archiving system and method
CN105678190A (en) * 2016-03-01 2016-06-15 福建省闽保信息技术股份有限公司 Data storage auditing system
EP3436923B1 (en) * 2016-05-04 2023-07-05 Pure Storage, Inc. Storage cluster
CN106845075B (en) * 2016-12-20 2021-07-20 杭州联众医疗科技股份有限公司 Centralized diagnosis report system
CN106681143B (en) * 2016-12-26 2019-08-06 武汉大音科技有限责任公司 A kind of adjustment method of the automation equipment based on cloud platform
US10599560B2 (en) * 2018-06-12 2020-03-24 Unity IPR ApS Method and system for improved performance of a video game engine
CN109104404B (en) * 2018-06-20 2022-03-29 广州中国科学院软件应用技术研究所 Dynamic encrypted medical big data system and method
CN109033345B (en) * 2018-07-24 2022-07-15 中国科学技术大学 Distributed data archiving parameter configuration method for large scientific device control system
US12086450B1 (en) 2018-09-26 2024-09-10 Amazon Technologies, Inc. Synchronous get copy for asynchronous storage
CN109639591B (en) * 2018-12-07 2022-07-26 国网浙江省电力有限公司 Method and system for reverse transmission of power distribution data, and computer-readable storage medium
WO2021014324A1 (en) * 2019-07-19 2021-01-28 JFrog Ltd. Data archive release in context of data object
KR102213368B1 (en) * 2019-10-10 2021-02-08 엔시큐어 주식회사 System and Method for Searching Multi-Keyword at High Speed
CN110837592B (en) * 2019-11-08 2021-01-26 京东数字科技控股有限公司 Method, apparatus and computer readable storage medium for data archiving
CN111159102A (en) * 2019-12-20 2020-05-15 中国建设银行股份有限公司 Unstructured data archiving method, device, equipment and storage medium
KR102559290B1 (en) * 2020-01-06 2023-07-26 주식회사 아미크 Method and system for hybrid cloud-based real-time data archiving
US11556497B2 (en) * 2020-01-06 2023-01-17 Armiq Co., Ltd. Real-time archiving method and system based on hybrid cloud
US11770271B2 (en) * 2020-08-21 2023-09-26 Samsung Electronics Co., Ltd. Data center
CN115543214B (en) * 2022-11-25 2023-03-28 深圳华锐分布式技术股份有限公司 Data storage method, device, equipment and medium in low-delay scene
US12348617B2 (en) 2023-01-12 2025-07-01 Bank Of America Corporation Systems, methods, and apparatuses for generating data strings and for managing encrypted data in data containers in an electronic network
CN118427158B (en) * 2024-07-04 2024-10-11 广州劲源科技发展股份有限公司 File development and utilization management system based on artificial intelligence technology

Family Cites Families (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4309569A (en) * 1979-09-05 1982-01-05 The Board Of Trustees Of The Leland Stanford Junior University Method of providing digital signatures
JPH05113963A (en) * 1991-10-23 1993-05-07 Nec Corp Job state display system
US5243381A (en) * 1993-01-04 1993-09-07 Xerox Corporation Method for compiling multiple jobs with job reference sheets
JPH10261075A (en) * 1997-03-21 1998-09-29 Matsushita Electric Ind Co Ltd Image buffer control device
JP3805985B2 (en) * 1999-02-18 2006-08-09 株式会社東芝 Stream data information storage medium, recording method, reproducing method, recording apparatus, and reproducing apparatus
US6604224B1 (en) * 1999-03-31 2003-08-05 Diva Systems Corporation Method of performing content integrity analysis of a data stream
US6959384B1 (en) * 1999-12-14 2005-10-25 Intertrust Technologies Corporation Systems and methods for authenticating and protecting the integrity of data streams and other data
US20020103815A1 (en) * 2000-12-12 2002-08-01 Fresher Information Corporation High speed data updates implemented in an information storage and retrieval system
US7685126B2 (en) * 2001-08-03 2010-03-23 Isilon Systems, Inc. System and methods for providing a distributed file system utilizing metadata to track information about data stored throughout the system
WO2004109552A2 (en) * 2003-06-03 2004-12-16 Access Co., Ltd. Method for browsing contents using page storing file
US20050050342A1 (en) * 2003-08-13 2005-03-03 International Business Machines Corporation Secure storage utility
JP2005122311A (en) * 2003-10-14 2005-05-12 Nippon Telegraph & Telephone East Corp Advertisement presenting method, apparatus and program
US20050203976A1 (en) 2004-02-11 2005-09-15 University Of California Systems, tools and methods for transferring files and metadata to and from a storage means
US7277905B2 (en) * 2004-03-31 2007-10-02 Microsoft Corporation System and method for a consistency check of a database backup
CN101043372A (en) * 2006-03-22 2007-09-26 比特福恩公司 Equipment simple document search of management network
JP4767057B2 (en) * 2006-03-27 2011-09-07 富士通株式会社 Hash value generation program, storage management program, determination program, and data change verification device
US8862841B2 (en) * 2006-04-25 2014-10-14 Hewlett-Packard Development Company, L.P. Method and system for scaleable, distributed, differential electronic-data backup and archiving
US7840969B2 (en) * 2006-04-28 2010-11-23 Netapp, Inc. System and method for management of jobs in a cluster environment
JP2007299308A (en) * 2006-05-02 2007-11-15 Ricoh Co Ltd Job processing system, job processing method, program, and recording medium
JP4972358B2 (en) * 2006-07-19 2012-07-11 株式会社リコー Document search apparatus, document search method, document search program, and recording medium.
US8161353B2 (en) * 2007-12-06 2012-04-17 Fusion-Io, Inc. Apparatus, system, and method for validating that a correct data segment is read from a data storage device
US9124650B2 (en) * 2006-12-13 2015-09-01 Quickplay Media Inc. Digital rights management in a mobile environment
US8055902B2 (en) * 2007-01-12 2011-11-08 International Business Machines Corporation Method, system, and computer program product for data upload in a computing system
US8112424B2 (en) * 2008-03-11 2012-02-07 International Business Machines Corporation Flexible and resilient information collaboration management infrastructure
US9344401B2 (en) * 2009-02-04 2016-05-17 Citrix Systems, Inc. Methods and systems for providing translations of data retrieved from a storage system in a cloud computing environment
JP5383297B2 (en) * 2009-04-13 2014-01-08 株式会社日立国際電気 Signature device
JP5695040B2 (en) * 2009-06-26 2015-04-01 シンプリヴィティ・コーポレーション File system
JP5415183B2 (en) * 2009-08-20 2014-02-12 株式会社日立ソリューションズ Batch job processing device, batch job processing system
US8990585B2 (en) * 2009-12-29 2015-03-24 Cleversafe, Inc. Time based dispersed storage access
JP2011170667A (en) * 2010-02-19 2011-09-01 Nec Corp File-synchronizing system, file synchronization method, and file synchronization program
JP5569074B2 (en) * 2010-03-19 2014-08-13 日本電気株式会社 Storage system
US8640225B2 (en) * 2010-09-24 2014-01-28 Nokia Corporation Method and apparatus for validating resource identifier
US8538938B2 (en) * 2010-12-02 2013-09-17 At&T Intellectual Property I, L.P. Interactive proof to validate outsourced data stream processing
US8589257B2 (en) * 2010-12-31 2013-11-19 Nulogy Corporation Method, system and apparatus for managing inventory

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
"Amazon Elastic MapReduce: Developer Guide", 12 June 2012 (2012-06-12), XP055197370, Retrieved from the Internet <URL:https://web.archive.org/web/20120612043953/http://s3.amazonaws.com/awsdocs/ElasticMapReduce/latest/emr-dg.pdf> [retrieved on 20150622] *
"Amazon Glacier Developer Guide", 20 August 2012 (2012-08-20), XP055197295, Retrieved from the Internet <URL:https://web.archive.org/web/20120908043705/http://awsdocs.s3.amazonaws.com/glacier/latest/glacier-dg.pdf> [retrieved on 20150622] *
DEVELOPER GUIDE: "AWS Import/Export", 12 June 2012 (2012-06-12), XP055197345, Retrieved from the Internet <URL:https://web.archive.org/web/20120612051330/http://s3.amazonaws.com/awsdocs/ImportExport/latest/AWSImportExport-dg.pdf> [retrieved on 20150622] *
DUANG, AILING: "Research and application of distributed parallel search hadoop algorithm", SYSTEMS AND INFORMATICS (ICSAI), 2012 INTERNATIONAL CONFERENCE ON, IEEE, 19 May 2012 (2012-05-19), pages 2462 - 2465, XP032193030, ISBN: 978-1-4673-0198-5, DOI: 10.1109/ICSAI.2012.6223552 *

Also Published As

Publication number Publication date
CN104603776B (en) 2020-05-12
AU2018204309B2 (en) 2020-10-29
KR101954594B1 (en) 2019-03-06
JP2017182825A (en) 2017-10-05
AU2016201923A1 (en) 2016-04-21
SG11201500836QA (en) 2015-03-30
JP6165862B2 (en) 2017-07-19
AU2013299731A1 (en) 2015-02-26
EP3805941A1 (en) 2021-04-14
CN104603776A (en) 2015-05-06
KR20160058198A (en) 2016-05-24
CA2881567A1 (en) 2014-02-13
KR101825905B1 (en) 2018-03-22
EP3805941B1 (en) 2024-04-17
WO2014025820A3 (en) 2014-05-01
KR20170092712A (en) 2017-08-11
AU2018204309A1 (en) 2018-07-05
EP2883170A2 (en) 2015-06-17
CA2881567C (en) 2023-10-17
WO2014025820A2 (en) 2014-02-13
JP6463796B2 (en) 2019-02-06
SG10201600997YA (en) 2016-03-30
JP2015534142A (en) 2015-11-26
KR101766214B1 (en) 2017-08-09
BR112015002837A2 (en) 2017-08-08
KR20150041056A (en) 2015-04-15

Similar Documents

Publication Publication Date Title
SG10201600997YA (en) Archival data storage system
PL2920088T3 (en) Storage system
EP2883132A4 (en) Archival data identification
GB2527951B (en) Storage system
GB201322400D0 (en) Oliugonucleotide data storage on solid supports
GB2515705B (en) Data syncronisation
IL243953A0 (en) Secure data storage
EP2926255A4 (en) Data reliability schemes for data storage systems
EP2754053A4 (en) Storage system
EP2756403A4 (en) Storage system
IL229099A0 (en) Secure data storage
ZA201305211B (en) Data solutions system
GB201414220D0 (en) Remote storage system
EP2998673A4 (en) Heat storage system
LU91968B1 (en) Binary data store
EP3043122A4 (en) Heat storage system
GB2500237B (en) Data storage system
PL2854350T3 (en) System and method for cross-network data storage
EP2921966A4 (en) Data sharing system
GB201320197D0 (en) Data storage system
GB2504312B (en) Secure data transfer
LU91969B1 (en) Binary data store
GB201102606D0 (en) Data storage system
GB201317695D0 (en) Data confirmation system
SG10201703611UA (en) System and methods for distributed data storage

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150309

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20150630

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 17/30 20060101AFI20150624BHEP

Ipc: G06Q 10/00 20120101ALI20150624BHEP

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20160426

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20200921