?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Replicability+is+not+Reproducibility%3A%0D%0ANor+is+it+Good+Science&rft.creator=Drummond%2C+Dr.+Chris&rft.subject=Artificial+Intelligence&rft.description=++At+various+machine+learning+conferences%2C+at+various+times%2C+there+have+been+discussions+arising+from+the+inability+to+replicate+the+experimental+results+published+in+a+paper.+There+seems+to+be+a+wide+spread+view+that+we+need+to+do+something+to+address+this+problem%2C+as+it+is+essential+to+the+advancement+of+our+field.+The+most+compelling+argument+would+seem+to+be+that+reproducibility+of+experimental+results+is+the+hallmark+of+science.+Therefore%2C+given+that+most+of+us+regard+machine+learning+as+a+scientific+discipline%2C+being+able+to+replicate+experiments+is+paramount.++I+want+to+challenge+this+view+by+separating+the+notion+of+reproducibility%2C+a+generally+desirable+property%2C+from+replicability%2C+its+poor+cousin.+I+claim+there+are+important+differences+between+the+two.++Reproducibility+requires+changes%3B+replicability+avoids+them.+Although+reproducibility+is+desirable%2C+I+contend+that+the+impoverished+version%2C+replicability%2C+is+one+not+worth+having.&rft.date=2009-06-18&rft.type=Conference+Paper&rft.type=PeerReviewed&rft.format=application%2Fpdf&rft.identifier=http%3A%2F%2Fcogprints.org%2F7691%2F7%2FICMLws09.pdf&rft.identifier=++Drummond%2C+Dr.+Chris++(2009)+Replicability+is+not+Reproducibility%3A+Nor+is+it+Good+Science.++%5BConference+Paper%5D+++++&rft.relation=http%3A%2F%2Fcogprints.org%2F7691%2F