Analyze some Data using Spark

Updated proposal: Script to process the datasets with PySpark. 2 types of the output should be implemented: 1) CSV file per each dashboard (for each type of analysis) 2) Graphical python output (with ggplot or similar lib) List of analytic queries:  Top N Tags based on item-tag/tags files (citeulike-a)  Camparision between Top N words used in both the data sets (citeulike-a and citeulike-t) (comparison word cloud) (using [login to view URL] and [login to view URL])  Top N words used in dataset citeulike- a and citeulike-t (individually) (commonality cloud)  Top N papers which have highest no. of citations (citeulike-a )  Top N articles which used highest number of words (analysis on [login to view URL]) (citeulike-a)  Top N users, whose items has maximum tags (citeulike-a)  Top N users, who have maximum items (citeulike-a)  Top N highly used items (citeulike-a)  Top N users whose items are most cited (citeulike-a)  Top N citations used (citeulike-a)  Top N articles based on tag-items (citeulike-t)  Comparison between Top N users, whose items has maximum tags in citeulike-a and citeulike-t  Comparison between Top N users, who have maximum items in citeulike-a and citeulike-t  Comparison between Top N highly used items in citeulike-a and citeulike-t  Comparison between Top N articles which used highest number of words in citeulike-a and citeulike-t ============================================================================= Hi, I have an experience with etl developmen

Greetings sir, i am an expert freelancer for this job and your 100% satisfaction is assured if you allow me to serve. Here is the reason. Why you should pick me? a) I am a very expert and have the same kind of experience of 5 years. b) I work very hard (16+ hours a day and 7 days a week) and also very fast so... it will be done very soon than most of the other providers c) And most important part is my policy: "I will give you (to my client) life time support (as long as you keep relation with me). And fix any bugs/problem without any cost. So, don't ever worry about me” Please sir, leave a reply ASAP, as I am waiting for your kind reply

20+ years industry work experience in the area of IT, Finance & Banking. Also, I have 4+ years of experience in Economics, Business Analytics and Advanced statistics projects using software such as Python, R, SPSS, Minitab, Matlab, Big Data Analytics, Hadoop(Hive, PIG, SPARK, SCALA, ADAM, SSH/OpenSSH, Ansible, etc), Excel Data Pack, AIIMS, Tableau, Dashboard, PhotoShop,Illustrator, Sketch, Android, UI/UX, etc. and statistical tools and methods such as Multiple Regression Analysis, Correlation, Market Basket Analysis, Linear Programming, Monte Carlo Analysis, Principal Component Analysis, ANOVA/MANOVA/ANCOVA, Time Series, ARIMA, ARMA, ARCH, GARCH and financial analysis such as Financial Projections, Ratio analysis, Balance sheet and P&L Analysis, Cash Flow analysis, Fundamental analysis and Technical analysis. I also have good knowledge and experience of Project Management tools and body of knowledge such as scope and time management, budgeting, critical path, and network diagram, etc. I have performed economic analysis such as Price and Demand, Prices and Production, Demand and Supply, Free Trade, National Income, Balance of Payment, Exchange Rates and relative prices, Equilibrium in Forex Market, Money, Interest Rate and Exchange rate, Aggregate demand, etc I am B.S c(Electronics), PGHDSM (Systems Management, NIIT), GMTP(Financial Management, ICICI), PGDM (Marketing, AIMA), EPBABI(Business Analytics and Intelligence, IIM Ranchi). Digital Marketing Certification from NIESBUD

Hello. How are you. I have read and understood the project. I have strong knowledge in Probability and Statistics. And I'm expert in R, Matlab, Python, Spark etc. I'm interested this project. So, firstly I want to discuss with you about this project. Then I'll be happy. I wait for your good reply. Thanks.

Your project is a perfect macth for my skills. Looking forward to walk you through my portfolio during a short skype session. best regards, Joerg.

Hi there, I'm a professional Big Data software developer and CS graduate. I'm having expertise in developing software using Hadoop, Spark, HBase, Scala, Cassandra etc. See some of the works in my portfolio. Ping me for discussion.

Hey, I am data engineer working in an Online Advertisement firm. I have worked on many spark, pig projects I will be able to help you solve these problem. Please have a look at my profile and we can discuss more. Thanks

Though I am new here but my team has 3 years of experience into Apache/Spark/Akka. Can very well execute this Project

I have strong 11+ years of experience in SQL and data analytics. I can be trusted to deliver a robust and sound solution for your requirement. Once I see your requirement I can provide you more details. Thanks Sovan

I have done couple of similar project using Apache Spark & Scala, implemented to import large transaction files and process in the spark and push the results to the Hive tables post processing for Visualization.

Hello. I have prior experience with spark and PySpark. I have been working on analyzing massive datasets using Spark before. I also have experience with the requisite visualizations. If you can let me know the exact details of the project, I will describe the planned road-map. Feel free to contact me anytime you like. Thanks in advance.

A proposal has not yet been provided

currently I am working on same kind of requirement.

I am a spark except. can help you here.