?url_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adc&rft.title=Binding+and+Normalization+of+Binary+Sparse+Distributed+Representations+by+Context-Dependent+Thinning&rft.creator=Rachkovskij%2C+Dmitri+A.&rft.creator=Kussul%2C+Ernst+M.&rft.subject=Artificial+Intelligence&rft.subject=Neural+Nets&rft.description=Distributed+representations+were+often+criticized+as+inappropriate+for+encoding+of+data+with+a+complex+structure.+However+Plate's+Holographic+Reduced+Representations+and+Kanerva's+Binary+Spatter+Codes+are+recent+schemes+that+allow+on-the-fly+encoding+of+nested+compositional+structures+by+real-valued+or+dense+binary+vectors+of+fixed+dimensionality.+In+this+paper+we+consider+procedures+of+the+Context-Dependent+Thinning+which+were+developed+for+representation+of+complex+hierarchical+items+in+the+architecture+of+Associative-Projective+Neural+Networks.+These+procedures+provide+binding+of+items+represented+by+sparse+binary+codevectors+(with+low+probability+of+1s).+Such+an+encoding+is+biologically+plausible+and+allows+to+reach+high+information+capacity+of+distributed+associative+memory+where+the+codevectors+may+be+stored.+In+distinction+to+known+binding+procedures%2C+Context-Dependent+Thinning+allows+to+support+the+same+low+density+(or+sparseness)+of+the+bound+codevector+for+varied+number+of+constituent+codevectors.+Besides%2C+a+bound+codevector+is+not+only+similar+to+another+one+with+similar+constituent+codevectors+(as+in+other+schemes)%2C+but+it+is+also+similar+to+the+constituent+codevectors+themselves.+This+allows+to+estimate+a+structure+similarity+just+by+the+overlap+of+codevectors%2C+without+the+retrieval+of+the+constituent+codevectors.+This+also+allows+an+easy+retrieval+of+the+constituent+codevectors.+Examples+of+algorithmic+and+neural+network+implementations+of+the+thinning+procedures+are+considered.+We+also+present+representation+examples+of+various+types+of+nested+structured+data+(propositions+using+role-filler+and+predicate-arguments+representation%2C+trees%2C+directed+acyclic+graphs)+using+sparse+codevectors+of+fixed+dimension.+Such+representations+may+provide+a+fruitful+alternative+to+the+symbolic+representations+of+traditional+AI%2C+as+well+as+to+the+localist+and+microfeature-based+connectionist+representations.&rft.date=1999-03&rft.type=Preprint&rft.type=NonPeerReviewed&rft.format=application%2Fpostscript&rft.identifier=http%3A%2F%2Fcogprints.org%2F537%2F2%2FCdt.ps&rft.identifier=++Rachkovskij%2C+Dmitri+A.+and+Kussul%2C+Ernst+M.++(1999)+Binding+and+Normalization+of+Binary+Sparse+Distributed+Representations+by+Context-Dependent+Thinning.++%5BPreprint%5D++++(Unpublished)++&rft.relation=http%3A%2F%2Fcogprints.org%2F537%2F