简介:当前的流行系统,Hadoop和火花,当运行反复的大数据应用程序时,因为计算和通讯的低效的重叠,不能完成满足的性能。计算,数据运动,和数据管理的管道为计算系统的当前的分布式的数据起一个关键作用。在这份报纸,我们首先分析开销洗牌在Hadoop的操作并且当运用PageRank工作量时,发出火花,然后建议一条事件驱动管道和在里面记忆洗牌有更好作为DataMPI重复计算和通讯重叠的设计,一个基于MPI的图书馆,为反复的大数据计算。我们的表演评估表演DataMPI重复能为PageRank和K工具在Apache火花上在ApacheHadoop,和2X3X加速上完成9X21X加速。
简介:Thispaperpresentsadatafusionmethodindistributedmulti-sensorsystemincludingGPSandINSsensors'dataprocessing.First,aresidualχ2-teststrategywiththecorrespondingalgorithmisdesigned.Thenacoefficientmatricescalculationmethodoftheinformationsharingprincipleisderived.Finally,thefederatedKalmanfilterisusedtocombinetheseindependent,parallel,real-timedata.Apseudolite(PL)simulationexampleisgiven.
简介:Thepoorresolutionofconventionalseismicdatacouldnotfititforreservoirdescription.Meanwhileonlyseismicdatacouldprovide3-Dinformationofreservoir,itisveryimportanttoimproveresolutionofseismicdata.Hereamethodisputforward,byusinginversiontechniques,toimprovetheseismicdatawiththequalityofhigherresolutionandlowernoise.Thespecificcharacterofthismethodistheusageofgeologicrulesinprocessingseismicdata,whichisquitedifferentfromthehypothesisofsomedeconvolution.Therearealwayssomeassumptionsaboutwaveletorreflectseriesinconventionaldeconvolutionisnotappropriate.Applicationofthismethodonseismicdatafromseveraloilfieldsshowitseffectiveneseandefficency.
简介:传统的地震数据采样跟随Nyquist采样定理。在这份报纸,我们介绍压缩察觉到的理论(CS),突破传统的Nyquist采样定理的限制,显示进用随机的undersampling的无害的支离破碎的随机的噪音的常规undersampling的协调别名,并且有效地把重建问题变成一个简单得多的降噪问题。我们介绍设计到凸的集合(POCS)上在数据重建的算法处理,在重复使用指数的腐烂阀值参数,并且修改执行在时空域的前面、反向的变换的传统的重建进程。我们建议使用在空间领域提交并且逆行变换的一个新方法。建议方法使用更少的计算机记忆并且改进计算速度。我们也分析antinoise和建议方法的抗混叠能力,并且比较2D和3D数据重建。理论模型和真实数据证明建议方法是有效的并且实际重要性,它能重建错过踪迹并且减少复杂数据的探索费用获得。
简介:Largesizedpowertransformersareimportantpartsofthepowersupplychain.Theseverycriticalnetworksofengineeringassetsareanessentialbaseofanation'senergyresourceinfrastructure.Thisresearchidentifiesthekeyfactorsinfluencingtransformernormaloperatingconditionsandpredictstheassetmanagementlifespan.Engineeringassetresearchhasdevelopedfewlifespanforecastingmethodscombiningreal-timemonitoringsolutionsfortransformermaintenanceandreplacement.Utilizingtherichdatasourcefromaremoteterminalunit(RTU)systemforsensor-datadrivenanalysis,thisresearchdevelopsaninnovativereal-timelifespanforecastingapproachapplyinglogisticregressionbasedontheWeibulldistribution.Themethodologyandtheimplementationprototypeareverifiedusingadataseriesfrom161kVtransformerstoevaluatetheefficiencyandaccuracyforenergysectorapplications.Theassetstakeholdersandsupplierssignificantlybenefitfromthereal-timepowertransformerlifespanevaluationformaintenanceandreplacementdecisionsupport.
简介:Backgroundknowledgeisimportantfordatamining,especiallyincomplicatedsituation.Ontologicalengineeringisthesuccessorofknowledgeengineering.Thesharableknowledgebasesbuiltonontologycanbeusedtoprovidebackgroundknowledgetodirecttheprocessofdatamining.ThispapergivesacommonintroductiontothemethodandpresentsapracticalanalysisexampleusingSVM(supportvectormachine)astheclassifier.GeneOntologyandtheaccompanyingannotationscomposeabigknowledgebase,onwhichmanyresearcheshavebeencarriedout.MicroarraydatasetistheoutputofDNAchip.WiththehelpofGeneOntologywepresentamoreelaborateanalysisonmicroarraydatathanformerresearchers.Themethodcanalsobeusedinotherfieldswithsimilarscenario.
简介:Curvemodelingisoneofthebasicworkincomputeraidedgeometricdesignandcomputergraphics.Fortheimplicitconicfittingprobleminthispaper,theresearchmethodsthattheobjectivefunctionbasedontheminimalalgebraicdistanceandgeometricdistancearesummarized.Theadvantagesanddisadvantagesofeverymethodareanalyzedsimply,andtheapplicationsoftheconicfittingarelisted.
简介:AvisualizationtoolwasdevelopedthroughawebbrowserbasedonJavaappletsembeddedintoHTMLpages,inordertoprovideaworldaccesstotheEASTexperimentaldata.Itcandisplaydatafromvarioustreesindifferentserversinasinglepanel.WithWebScope,itiseasiertomakeacomparisonbetweendifferentdatasourcesandperformasimplecalculationoverdifferentdatasources.
简介:Theboundedparameterestimationproblemanditssolutionleadtomoiemeaningfulresults.Itssuperiorperformanceisduetothefactthatthenewmethodguaranteesthattheeffectoftheuncertaintieswillneverbeunnecessarilyoverestimated.Wethenconsiderhowtoupdateanddowndatetheboundedparameterestimationproblem.WhenupdatinganddowndatingofSVDareusedtothenewproblem,specialtechnologiesaretakentoavoidformingUandVexplicitly,thenincreasethealgorithmperformance.BecauseofthelinkbetweentheboundedparameterestimationandTikhonovregularizationprocedure,wepointoutthatouralgorithmscanalsobeusedtomodifyregularizationproblem.
简介:Inthispaper,twokindsofKullback-Leiblercriteriawithappropriateconstraintsareproposedtoconstructempiricallikelihoodconfidenceintervalsforthemeanofrightcensoreddata.ItisshownthatoneofthecriteriaisequivalenttoAdimari's(1997)procedure,andtheothersharesthesameasymptoticbehavior.
简介:ThepurposeofthispaperistostudytheRSdatawebservicesandrelatedsubjectsofdatastorageanddatamanagement.Basedonananalysisofthepresentsituationanddevelopmenttrendofstorageandmanagementofrasterdataandwebservicetechnology,amanagementandservicesystemarchitectureforRemoteSensingrasterdatabasedonwebservicetechnologieswasdeveloped,theimplementationmethodologiesofthekeytechnologyofthesystemwereexploredandaprototypeofthesystemwasillustrated.
简介:Inthispaper,ARMiner,adataminingtoolbasedonassociationrules,isintroduced.Beginningwiththesystemarchitecture,thecharacteristicsandfunctionsaredis-cussedindetails,includingdatatransfer,concepthierarchygeneralization,miningruleswithnegativeitemsandthere-developmentofthesystem.Anexampleofthetool'sapplicationisalsoshown.Finally,someissuesforfutureresearcharepresented.