Wednesday, June 18, 2008

Schedule for the open source Datastage tool (codename: dsSurfer)

One of the things I have always wished to do was, to work on an Open source project and get to interact with the peers in my domain. Thanks to DSXchange my wish has been partially fulfilled as I get to interact with the best minds working on Datastage. There are quite a lot of reasons why we don't have open source projects in Datastage, I am not going to dive into those details.

The motivation behind this initiative is my wish to make open source projects in Datastage a possiblity. Once I decided that I am going to start an open source initiative, All I had to do was dive into the posts at DSXchange and find out the most common things that Datastage users wanted. My first open-source project is going to be the creation of a few utilities which would help the developers do a few things using "an easy to use GUI". With that said, let's jump into the windows utility which we are going to create. I have given it a codename dsSurfer (it isn't very cool, But I am expecting you guys to help me out with the actual name). Now dsSurfer would be a Windows application (similar to DelimitedFileViewer) which would have a GUI just like any other desktop application and it would work from desktops which have Datastage client components installed on them. And it would broadly do the following mentioned below this para. Please post comments on what *else* you would like to see in this tool and we'll see if we can accomodate them into this release.

  • Launch Datastage client components.
  • Generate job reports
  • Schedule backups of projects

Also, I would need a lot of help from the experts at DSXchange in figuring out the best possible way to do these things. I have also planned a schedule for the release dsSurfer.

# Schedule

  • 06/18: Post it on the blog
  • 06/20: Freeze the requirements and post the final requirements on my blog.
  • 06/25: Finish the UI
  • 07/05: Finish the coding for req 1 and req 3
  • 07/15: Finish the coding for req2
  • 07/17: Finish the complete integration and test it on 7.5x2 and 8.x thoroughly.
  • 07/18 - 07/20: Alpha testing
  • 07/20 - 07/25: Beta testing
  • 07/26 - 07/28 : Bug fixing
  • 07 /28: Final Release

Requirements:
This tool would have the abilities to:

Generate job reports

  • It has to have the ability to search jobs and generate reports of jobs selected from the list box.
  • If one of the jobs is a sequence, it needs to generate a report listing all the jobs used in the sequence.
  • A way to integrate all the reports into one html document?

Schedule backups of projects
Options to schedule backups of:

  • All projects on a server
  • Selected projects from a server
  • Optionally zipping the dsx files

Launch Datastage client components

  • Store the user id and password associated with a datastage server (Use encryption to store the passwords).
  • Launch Designer, Manager, Administrator and the Director.
  • Options to store as many server/user combinations as possible.

Technology to be used:

I am going to use C# 2.0 to write all the front end code and may be use the Datastage API to get the information needed from Datastage. Also, I'll be putting up the screenshots, the pieces of code which I come up with, on this blog. And hopefully by 28th July 2008, we will have a cool tool (with a cooler name ;) ) to make life in Datastage easier and more fun.

Please post your valuable comments on the requirements and other stuff.

************************************************************************

Updates on 06/23/2008:

I was expecting a lot of suggestions on dsSurfer :O (I got a couple of suggestions from Amey and Uma Maheshwar) But, I guess I was too overzealous about this whole thing. Since the requirements have not changed, I thought that just updating this post would do.

I'll go ahead with the requirements posted above, Very soon (hopefully ;) ) you guys will get a peek at what's in store for dsSurfer. I'll be posting the screenshots of UI once I am done with it. Hope to recieve your continuos support ;)

************************************************************************

73 comments:

Anonymous said...

I am very happy to see this post becuase you are working hard to make other datastage developers life easy.I have one suggestion if you include running datastage jobs from that GUI by passing the parameters to that job.It will help very much if possible for you

Minhajuddin said...

That is a good idea uma maheswar.
It wouldn't be too hard to add this functionality into dsSurfer. But, I am trying to add things which are *not* provided by IBM out of the box. Anyway, this would be a good little addition to the functionality.

uma said...

Hi,how is your work going.Are you adding Run job functionality to your requirements or not.If you need any help please post it in the blog.I will try to help you as much as i can

Thanks
Uma

T rex said...

I am sorry if I am late. I would like to share another idea that I have been contemplating for a long time now. I wanted a tool to be able to write and delete rows from a dataset. This is not done at the moment by orchadmin, but it would be a really nice feature. It will be particularly helpful when we try to test intermediate jobs with dataset as source and we need to test jobs with different test rows.

Anonymous said...

Hello there...

I'm a DS Developer from Brasil at a company that have a branch in your country.

I am too willing to develop some opensource tools for DS. Don't you think programming this stuff in java would be better to port the solutions other platforms ?

In case you want to discuss about this, please feel free to contact me. Would really like to engage in an opensource project on DS.

My e-mail: gorni.henrique at gmail.com

Minhajuddin said...

I apologize for slipping on the schedule. I was out on an unplanned vacation and so, didn't have much time to work on this app.

@mahesh
I'll try to add that functionality to dsSurfer.

@t rex
You've got a great idea there, And I agree that it would be very helpful for all of us if there was some kind of functionality to edit the data in datasets. The unfortunate thing is that the data in datasets is stored in the datastage internal format (I don't know if this is published by IBM), So reading the data directly and doing some conversion is out of the picture. The only option as far as I can think, to make datasets "editable" is to read them using orchadmin and then save the changes back into the dataset by using an orchestrate script. This would be a bit complex, Maybe we can take up in the next release of dsSurfer or come up with a new utility for that :D Thanks for your suggestion !


@Henrique
You are right that developing it in Java would make it more independent of the platform. I chose .Net just because it's easier to develop (for me) in it, also that the datastage clients as of now can be installed only on Windows machines.

I'll post the screenshots shortly and if any of you guys are willing to improve them or want to develop the code for this you are Welcome :D

Anonymous said...

how to buy viagra lowest price viagra buy sublingual viagra online cheapest viagra in uk cialis v s viagra viagra soft tabs buy viagra in england cheap viagra canada viagra rrp australia cheap viagra overnight generic brands of viagra online viagra prices how to get viagra viagra canada

Anonymous said...

Can anyone recommend the robust Remote Desktop utility for a small IT service company like mine? Does anyone use Kaseya.com or GFI.com? How do they compare to these guys I found recently: N-able N-central network manager
? What is your best take in cost vs performance among those three? I need a good advice please... Thanks in advance!

Anonymous said...

Your blog keeps getting better and better! Your older articles are not as good as newer ones you have a lot more creativity and originality now keep it up!

Anonymous said...

[url=http://seghan.ru/go.php?sid=35][img]http://s003.radikal.ru/i203/1001/17/1008f12c7936.jpg[/img][/url]












[url=http://cauvzah.weinend.de/]electric cigarettes where to buy [/url]
buying cigarettes in france where to buy fake cigarettes buy cigarettes at
[url=http://uvfaquc.akzentuiert.de/sitemap.html]19 to buy cigarettes [/url]
carton cigarette marlboro order cigarettes cheap cigarettes buy tobacco buy roll in cigarette filter tips
[url=http://vjzvmeu.il.gp/sitemap.html]buy super mini electronic cigarette [/url]
buy electronic cigarettes cigarettes by money orders buy us made cigarettes online
[url=http://ubpscsn.pro.ac/sitemap.html]buy cheap cigarettes in ireland [/url]
buying cigarettes indian reservations ordering cigarettes online canada black devil cigarettes buy
[url=http://vjzvmeu.il.gp/sitemap.html]ordering cigarettes [/url]
buying cigarettes online scam where can i buy cigarettes electronic cigarette cartridge order
[url=http://botziho.485.at/sitemap.html]mail order cigarettes indian [/url]
buying cigarettes online review cheap cigarettes online buy cheap marlboro buying cigarettes with credit card
[url=http://powjxun.wieder-mal.de/]cheapest country to buy cigarettes [/url]
buy player cigarettes where can i buy electronic cigarettes in appleton wisconsin buy electronic cigarette europe
[url=http://qzexaua.flackert.de/]buy russian cigarettes online [/url]
buy cigarettes with credit card buy cheap cigarettes with mastercard bulk order cigarettes
[url=http://tioozua.connection24.de/sitemap.html]buy black market cigarettes [/url]
buy salem cigarettes online buy cigarettes in ny buy cigarettes wholesale uk
[url=http://mlwqdwu.xn--baldmglichst-8ib.de/]buying clove cigarette [/url]
age to buy cigarettes in ohio order cigarettes online us best place online to buy cigarettes

Anonymous said...

Genial fill someone in on and this enter helped me alot in my college assignement. Thanks you for your information.

Anonymous said...

good morning friends. I'm actually into shoes and I had been digging allowing for regarding that meticulous brand. The prices due to the fact that the velcros are all over 300 pounds everwhere. But definitively I bring about this location selling them as a remedy for half price. I really want those [url=http://www.shoesempire.com]prada sneakers[/url]. I will probably buy these. what can you say about it?

Anonymous said...

Hello. And Bye.

Anonymous said...

good evening friends. I'm honestly into shoes and I had been looking allowing for regarding that singular model. The prices seeking the shoes were about 220 bucks on every site. But finally I set this locate selling them for half price. I absolutely love these [url=http://www.shoesempire.com]gucci sneakers[/url]. I will definetly purchase them. what can you say about it?

Anonymous said...

Approvingly your article helped me altogether much in my college assignment. Hats incorrect to you send, will look forward in behalf of more cognate articles in a jiffy as its one of my choice subject-matter to read.

Anonymous said...

Hey Everyone,

i have been trying to figure out a place to start the Acai Berry free trial & was wanting to know if anybody had some thoughts on whether or not the stuff works for dieting? So far here's the 1 [url=http://acaiberries.blinkweb.com/new-blog.html]article[/url] I've been able to check out that seemed real for what my goals are. Opinions?

Anonymous said...

I love minhajuddin.blogspot.com! Here I always find a lot of helpful information for myself. Thanks you for your work.
Webmaster of http://loveepicentre.com and http://movieszone.eu
Best regards

Anonymous said...

cheap alprazolam xanax during pregnancy - xanax overdose complications

Anonymous said...

srg purchase cialis , cheap generic cialis , order cialis , cheapest viagra , cheap viagra online , womens viagra

Anonymous said...

ttg generic cialis soft tabs , cialis soft pills , cialis wholesale , cialis for sale in uk , cialis for sale in canada , cialis for sale nyc

Anonymous said...

to cialis for daily use , cialis everyday pill , free cialis coupon , buy brand viagra online , prescription viagra , best price for viagra

Anonymous said...

arfe cialis soft tabs online , cialis for sale nyc , cialis samples free , where to buy viagra , buy viagra online uk , online viagra prescription

Anonymous said...

Great article. I am dealing with some of these issues as well.
.
my web page - free iphone 5

Anonymous said...

My programmer is trying to convince me to move to
.net from PHP. I have always disliked the idea because
of the expenses. But he's tryiong none the less. I've been using WordPress on
various websites for about a year and am anxious about switching to another platform.
I have heard great things about blogengine.net. Is there a way
I can transfer all my wordpress posts into it? Any help
would be greatly appreciated!
Also visit my site : www.yourtobaccosstore.com

Anonymous said...

Normally I do not read post on blogs, however I wish to say that this write-up
very compelled me to try and do it! Your writing taste
has been amazed me. Thank you, very great post.
My web page ... samson review

Anonymous said...

sdg viagra , pills viagra , viagra generic , cheap cialis , pills cialis , cialis price

Unknown said...

I am robert..Good work buddy... keep continuing... it shows yours commitment towards datastage field...

Anonymous said...

viagra online where to buy viagra in lincoln uk - safe purchase viagra online

Anonymous said...

burberry sale qjeowx rmwz www.fashionbulberryoutlet.com zxyeri ldot www.livebulberryfashion.com bhnmhd jrwm uggs outlet cnfega yixk ugg outlet store xwnply nqlp ugg outlet store qllfyu xaeh ugg discount ayhhlg twdc ugg sale mwwvgs liyq michael kors outlet poagno bnct michael kors handbags ipleun acgd michael kors outlet upgcut ijkc longchamp handbags sale cszbrx mskw longchamp outlet buaqrh jgtw longchamp bag sfhqvw julz burberry handbags jqwjoa cdcs

Anonymous said...

burberry outlet opoazb vons burberry uk utpetf bnyj burberry bags cchrmf upbe ugg sale nyrakq cpua ugg boots atqxvf rwfc ugg outlet online kkjved endg ugg boots outlet vjxbmz yjek ugg boots cheap ccbylb uylo http://www.jg20.com enajvk qads michael kors handbags mdouui obhn michael kors outlet coxuox jllh longchamp on sale hknfyq ytqb http://www.9dcu.com kpavul wavn http://www.dtr6.com yvifda gazr burberry outlet online nliqzh gyly

Anonymous said...

burberry symqay yruj burberry sale huiqgp ddaz burberry sale outlet sesggc znnw www.specjerseys.com vuemmu gdol www.numbjerseys.com mfifgz heeq ugg boots sale fcvwsy gbeo ugg outlet seojaf dmwl ugg sale ywxoga xzby michael kors outlet zgqhvy tjpa michael kors outlet store ytfpyk rons michael kors outlet qqbblo siam longchamp handbags sale mcyqvy aovv longchamp sale gyrokf rlqy http://www.dtr6.com iwxaud feqp burberry handbags wsdaqa vonr

Anonymous said...

burberry handbags pefasb thuf burberry sale vhtnbd yefb burberry outlet store jtpdsk hgvk uggs sale xddpdo tgsu ugg sale gpljzq odtz ugg outlet store fywryy ydcr ugg outlet hbzfpp anls ugg sale pfnhyb djwx http://www.jg20.com lhevah zxjh michael kors handbags uumuij ybrc michael kors outlet zqlqqy shnf longchamp handbags outlet wjdwqm kwkc longchamp outlet ctxajk xkxc longchamp bag kfsoat jbaj burberry diaper bag opllnp bssd

Anonymous said...

burberry outlet ltapwg qvis burberry outlet qlgmtf xgpf burberry sale outlet nvtloc hvfg ugg sale rjhkef tjmc ugg sale bwwlrf rsgf ugg outlet online wssmho cazv ugg boots outlet yzmelh coxt ugg sale fuunyf xzxe michael kors outlet zhdtfd ryth michael kors handbags npppvr ighj michael kors 2013 saxebt utkw longchamp on sale mhnegs qrao longchamp sale fegmpz zhdb longchamp bag xtfhtk yrpu burberry handbags oapoit aemo

Anonymous said...

burberry sale zwupnd qamj www.fashionbulberryoutlet.com rfnjoy awss www.livebulberryfashion.com vtnbwf gkks uggs uk wfidgb vqpe www.numbjerseys.com penucs emaa http://www.2lv6.com ybgtnj kqqc ugg outlet cemtua rprx ugg sale emafae fhmm michael kors online outlet kfsqxp aeil http://www.02s8.com pwvzne csyh michael kors 2012 llocmw swym longchamp outlet caihhc pney longchamp sale mbfpqd geyk http://www.dtr6.com vtrtmk qaxl burberry handbags lspvop ftli

Anonymous said...

burberry outlet cnuuzf dcnw burberry bags grdxni jbag burberry outlet store lejkdu ecrf uggs sale topjxq ohky ugg outlet online sale fyljez tars ugg on sale rehdbu qewe ugg boots outlet ffaomt xpik ugg boots cheap npodwi wajg michael kors handbags on sale otdfwh uizn michael kors tote chwrbb yhzb michael kors outlet goflwr kevt longchamp outlet store ndiwrg gllf http://www.9dcu.com akptri bdzs longchamp bag mqgxys dxtw burberry handbags qxpunr tdij

Anonymous said...

sildenafil citrate buy viagra kolkata - buy viagra brand online us

Anonymous said...

buy soma soma drug experiences - buy soma online no prescription needed

Anonymous said...

buy soma soma intimates online coupons - generic soma sale

Anonymous said...

soma online buy soma online in florida - information on soma pills

Anonymous said...

buy soma online buy soma online fedex - soma online no prescription

Anonymous said...

buy soma soma restaurant costa rica - buy cheap soma overnight

Anonymous said...

buy soma soma san diego pierce the veil - what does soma drug do

Anonymous said...

buy tramadol 100mg buy tramadol online usa - tramadol overdose damage

Anonymous said...

buy tramadol online tramadol overdose signs - buy tramadol online for dogs

Anonymous said...

tadalafil 20mg cialis daily wikipedia - cialis use in young men

Anonymous said...

hi viagra,price viagra , cialis online ,cialis prices
http://genericviagrarbs.com http://viagrapricesapf.com http://cialisonlinesya.com http://cialispriceschu.com

Anonymous said...

hi viagra,price viagra , cialis online ,cialis prices
http://genericviagrarbs.com http://viagrapricesapf.com http://cialisonlinesya.com http://cialispriceschu.com

Anonymous said...

hi viagra,price viagra , cialis online ,cialis prices
http://genericviagrarbs.com http://viagrapricesapf.com http://cialisonlinesya.com http://cialispriceschu.com

Anonymous said...

cheap alprazolam drug interactions methadone xanax - xanax bars tumblr

Anonymous said...

xanax online xanax brand online no prescription - what is xanax classification

Anonymous said...

purchase xanax generic xanax s 900 - xanax bars do you

Anonymous said...

buy carisoprodol carisoprodol buy - 350mg carisoprodol side effects

Anonymous said...

buy tramadol tramadol headache - buy tramadol online pay cod

Anonymous said...

generic cialis no prescription buy cialis walmart - generic cialis fda approved

Anonymous said...

buy cialis online cialis coupon printable - buy cialis generic

Anonymous said...

cialis online no prescription overnight cialis 5 mg - cialis 20mg price us

Anonymous said...

learn how to buy tramdadol tramadol for dogs for sale - ultram tramadol withdrawal

Anonymous said...

buy clonazepam klonopin withdrawal schedule - klonopin 93 833 side effects

Anonymous said...

buy klonopin online best high klonopin - klonopin versus generic

Anonymous said...

cd cheap viagra viagra,viagra pills cheap viagra, viagra online viagra pills,generic cialis viagra pills
http://cheapviagrapillsesl.com#viagra http://cheapviagrapillsvivt.com#viagra pills http://viagraonlinegenericth.com#generic viagra http://cheapcialisgenericsybf.com#cialis

Anonymous said...

Addiction-how it starts and what keeps a person addicted viagra pills generic viagra,viagra 100mg buy online buy 5 viagra pills, cialis cheap fast delivery generic viagra any good,cialis pills generic viagra illegal
http://genericviagrapillstzj.com#viagra online consultation http://viagraonline100mgxhy.com#viagra 100mg buy online http://cialispricecheapsfc.com#cialis http://cialispillscheapwr.com#where to buy cialis cheap

Anonymous said...

• When prescribing controlled drugs, risks of cialis generic cialis,cialis online cialis, viagra pills cialis online,cialis cialis online
http://genericcialisonlinevsdk.com#cialis price http://cialisonlinepricesrj.com#cialis price http://cheapviagrapillsesf.com#viagra http://genericcialisonlinevsdt.com#cialis

Anonymous said...

• When prescribing controlled drugs, risks of cialis generic cialis,cialis online cialis, viagra pills cialis online,cialis cialis online
http://genericcialisonlinevsdk.com#cialis price http://cialisonlinepricesrj.com#cialis price http://cheapviagrapillsesf.com#viagra http://genericcialisonlinevsdt.com#cialis

Anonymous said...

• When prescribing controlled drugs, risks of cialis generic cialis,cialis online cialis, viagra pills cialis online,cialis cialis online
http://genericcialisonlinevsdk.com#cialis price http://cialisonlinepricesrj.com#cialis price http://cheapviagrapillsesf.com#viagra http://genericcialisonlinevsdt.com#cialis

Anonymous said...

• When prescribing controlled drugs, risks of cialis generic cialis,cialis online cialis, viagra pills cialis online,cialis cialis online
http://genericcialisonlinevsdk.com#cialis price http://cialisonlinepricesrj.com#cialis price http://cheapviagrapillsesf.com#viagra http://genericcialisonlinevsdt.com#cialis

Anonymous said...

• When prescribing controlled drugs, risks of cialis generic cialis,cialis online cialis, viagra pills cialis online,cialis cialis online
http://genericcialisonlinevsdk.com#cialis price http://cialisonlinepricesrj.com#cialis price http://cheapviagrapillsesf.com#viagra http://genericcialisonlinevsdt.com#cialis

Anonymous said...



My homepage :: homepage

Anonymous said...

Yοur currеnt post offers vеrifіed benefiсial to me.
It’s quіte helрful and you're simply obviously really experienced in this region. You have got opened our eye for you to different views on this kind of subject matter together with intriguing and strong written content.
Here is my page :: Buy Valium

Anonymous said...



my page homepage

Anonymous said...



my page - web page

Anonymous said...



Have a look at my site: homepage

Anonymous said...



My weblog - web site

Anonymous said...



Stop by my website :: homepage