COBie Challenge 2013 Results


Every so often, the buildingSMART alliance (the body which manages COBie - Construction Operations Building Information Exchange), invites BIM (Building Information Modelling) software vendors to take part in a test project to determine how well their applications offer a robust transfer to COBie data. So did they stack up?

The Challenge: This covers several forms of software types which included:
  • Software for Planning (Programming)
  • Software for Design (Model Authoring)
  • Software for Construction (BIM Field & Construction Management)
  • Software for Facility Management (Asset Management & Facility Management)

A full list of details can be found here: http://www.buildingsmartalliance.org/index.php/projects/cobie
The 2013 tests carried out in January; were using the COBie 2.4 format. Each Vendor along with buildingSMART had developed a COBie “Toolkit” (plugin application) to streamline the export and comply with the COBie XML table format (eg MS Excel). Vendors were expected to have zero formatting errors, therefore, any row containing a formatting error was given a one-minute penalty (i.e. the time it would take to fix it manually).
For this Article, we will just look at "Software for Design". Any below text in "Italics" are direct exerts from the builidngSMART website.


Software for Design: “COBie Challenge events starting in 2013 checked software to determine
(1) if the format of the COBie file is correct, and
(2) if the content of the COBie file matches the content of the standard drawings.”

Below is the conclusion section of the results. A full detailed report is available on the buildingSMART Website (links below). Please read the full reports to truly understand the results.  

AutoDesk – Revit 2013


"Format Compliance: This company successfully completed the construction COBie challenge by producing the handover COBie file of the Medical Clinic model. Based on the quality control report, there was only one small error that incurred a one-minute penalty with respect to the internal consistency of the output format that would require an estimated 5 minutes to correct.

Content Quality: The vendor did not produce the 100% of the sample data; however the produced data was very accurate to expected sample data found on the project drawings. Based on the content quality criteria a 4 minutes penalty was applied as described in the session above. In sum, a total of 5 minutes was applied for the submitted file. This means that a user utilizing Autodesk Revit 2013 software is estimated to have to spend 9 minutes cleaning/fixing the COBie file for a facility of comparable size and complexity."


Bentley Systems - AECOsimBuilding Designer (beta) PDF


"Format Compliance: This company successfully completed the construction COBie challenge by producing the handover COBie file of the Medical Clinic model. No errors were encountered based on the quality control report; therefore, no penalty was applied for the data format, delivery of required fields, and proper referencing across the worksheets.

Content Quality: The quality of the produced data did not match 100% to the sample data provided and penalties were applied as described above. A total of 218 minutes (3.6 hours) penalty was applied for the data mismatch. This means that a user utilizing Bentley software would have to spend 3.6 hours fixing/cleaning the COBie file.

GraphiSoft - ArchiCAD17 (beta) PDF


"Format Compliance: This company successfully completed the construction COBie challenge by producing the handover COBie file of the Medical Clinic model. Based on the quality control report, were zero errors identified.

Content Quality: The vendor produced the architectural data of the model for a portion of the original clinic model. However, the provided data was inconsistent with the sample data which resulted in a penalty of 503 minutes (8 hours). This means that a user utilizing this product is estimated to have to spend 8 hours cleaning/fixing the COBie file for a facility of comparable size and complexity."


What is COBie: The below is an extract from Wikipedia
Construction Operations Building Information Exchange (COBie) is a data format for the publication of a subset of building model information focused on delivering building information not geometric modelling. It is closely associated with building information modelling (BIM) approaches to programming, design, construction and management of built assets, and was devised by Bill East of the United States Army Corps of Engineers, who authored a pilot standard in June 2007. COBie is currently managed by the buildingSMART alliance.

In short, COBie is a recognised process to specify, manage and record building asset data for hand over to the building facility management. Full information on COBie available here:

No comments:

Post a Comment

Please partake in the discussion. We welcome all feedback and comments, however spam will be removed from the comments section.