Lester Martin
Lester Martin
  • 140
  • 511 872
Apache Spark overview (part 3 of 3) | Below the waterline
Final video in a 3-part series providing an architectural overview of Apache Spark. This presentation discusses the narrow vs wide operations, the job/stage/task hierarchy, and cluster execution mode.
See XXXXX for the ordered playlist of all 3 of these videos.
Переглядів: 86

Відео

Apache Spark overview (part 2 of 3) | On the surface
Переглядів 24521 годину тому
Second video in a 3-part series providing an architectural overview of Apache Spark. This presentation discusses how datasets are distributed, introduces functional programming, and provides examples of the RDD and Dataframe APIs. See XXXXX for the ordered playlist of all 3 of these videos.
Apache Spark overview (part 1 of 3) | From 20,000 feet
Переглядів 27121 годину тому
First video in a 3-part series providing an architectural overview of Apache Spark. This presentation discusses the origin story, features, and the ecosystem components. See XXXXX for the ordered playlist of all 3 of these videos.
Gas chamber | Lester's Army tales
Переглядів 4514 днів тому
Sharing my 2nd "silly Army story" which makes the playlist an actual list now! This one focuses on the grueling day at Basic Training where you get the "opportunity" to build confidence in your protective mask by wearing it into a room full of tear gas. Oh, you also GET TO take if off in there, too. If you'll be attending US Army Basic Training soon, be sure to listen as I tell you what "advice...
What got me into the tech career some 30 odd years ago?
Переглядів 598 місяців тому
A little rambling video of how I ultimately landed on IT as a degree option that gave me a start over 30 years ago in my career. I hope you enjoy my ramble!
Live with Lester #1 (open Q&A + iceberg topics; S3 access & bucketing)
Переглядів 358 місяців тому
Well #1 is in the history books! It sure was a bit bumping and we didn't have a giant turnout, BUT... questions were asked & answered, knowledge was shared, and fun was had. It'll be awesome to look back when we hit the #10 episode and especially the #100 episode at how far we've come. This event was presented live on LinkedIn on May 30, 2024; www.linkedin.com/events/7199842229593481216/about/
Accessing Starburst from Databricks
Переглядів 2229 місяців тому
Just because you can access Starburst from the Databricks notebook environment doesn't mean you SHOULD do that. Anywho, just wanted to share to some folks it is easy enough to be done with PyStarburst since I was asked TWICE today if it was possible. In the demo, I imported the notebook at github.com/starburstdata/pystarburst-examples/blob/main/notebooks/astronauts_windows.ipynb and just ran it!
Hive to Iceberg (to migrate, or NOT to migrate)
Переглядів 1699 місяців тому
Presentation centered around IF you should migrate from Apache Hive table format to Apache Iceberg followed up by migration strategies with demonstrations throughout. See github.com/lestermartin/events/tree/main/2024-05-08_Hive2Iceberg for preso/demo artifacts.
Jumping off Reynold's Bend Rock Island on the Etowah River
Переглядів 339 місяців тому
Just cooling off with a little hop in the river. See blog post at martin.atlassian.net/wiki/x/FwAxBw.
Riding over a little ledge on The Etowah River
Переглядів 159 місяців тому
See blog post at martin.atlassian.net/wiki/x/FwAxBw.
More Maui Marriott Resort Rocks
Переглядів 249 місяців тому
Yep, another quick video of waves hitting the volcanic rock shore just outside our room at the Maui Marriott Resort
Maui Marriott Resort Rocks
Переглядів 169 місяців тому
Quick little video of water rolling into the rocks at the edge of the Marriott Resort in Wailea on Maui
Cloud Computing Benefits
Переглядів 109 місяців тому
Cloud Computing Benefits
Crab on Maluaka Beach
Переглядів 109 місяців тому
Crab on Maluaka Beach
Risk Analysis with Spark
Переглядів 9389 місяців тому
Risk Analysis with Spark
Risk Analysis with Pig
Переглядів 9839 місяців тому
Risk Analysis with Pig
Data Manipulation with Hive
Переглядів 1,4 тис.9 місяців тому
Data Manipulation with Hive
Streaming Data into HDFS
Переглядів 1,8 тис.9 місяців тому
Streaming Data into HDFS
Loading Data into HDFS
Переглядів 2,4 тис.9 місяців тому
Loading Data into HDFS
Operational Overview with Ambari
Переглядів 3,2 тис.9 місяців тому
Operational Overview with Ambari
ESS03: HDFS Architecture
Переглядів 329 місяців тому
ESS03: HDFS Architecture
ESS04: Ingesting Data
Переглядів 179 місяців тому
ESS04: Ingesting Data
ESS05: Parallel Processing Fundamentals
Переглядів 209 місяців тому
ESS05: Parallel Processing Fundamentals
ESS06: Hive Overview
Переглядів 329 місяців тому
ESS06: Hive Overview
ESS07: Pig Overview
Переглядів 139 місяців тому
ESS07: Pig Overview
ESS08: Spark Overview
Переглядів 169 місяців тому
ESS08: Spark Overview
ESS09: YARN Architecture
Переглядів 289 місяців тому
ESS09: YARN Architecture
ESS10: Backup and Recovery
Переглядів 119 місяців тому
ESS10: Backup and Recovery
ESS11: Hadoop Security
Переглядів 439 місяців тому
ESS11: Hadoop Security
ESS02: Ecosystem Components & Integration
Переглядів 259 місяців тому
ESS02: Ecosystem Components & Integration

КОМЕНТАРІ

  • @MichaelHeffels-ge9yh
    @MichaelHeffels-ge9yh 2 дні тому

    Thank you! Just the fix I was looking for. You’re a good guy for taking the time to make this. Thanks again!

  • @ptech88
    @ptech88 3 дні тому

    Moen is the best from a repair perspective. Very easy to fix and very easy to get parts

  • @johnrauch5304
    @johnrauch5304 4 дні тому

    Amazing!! I was thinking just as you that it was the cap on top. When I searched for a video, yours popped up first and surprisingly it was the exact same Moen style I have and I fixed the problem in 2-3 minutes. Thank you.

  • @BuckeeBorden
    @BuckeeBorden 9 днів тому

    Thanks I’ll watch several video your was the easy one and actually worked

  • @sukeshsuvarna3355
    @sukeshsuvarna3355 11 днів тому

    Hi @Lester Martin, I tried to create a catalog from the postgres details given in the Lab1 section. It seems the user/password is incorrect as I am getting the invalid credential error. Kindly assist.

    • @LesterMartinATL
      @LesterMartinATL 11 днів тому

      Unfortuantely, those credentials do expire as we can't just offer free access to read/write from an S3 bucket nonstop. My recommendation is to work through the exercises at academy.starburst.io/build-a-data-transformation-pipeline-with-dbt-and-starburst-galaxy which should have valid credentials along with the instructions you'll find there. If not, we can get that fixed if anything isn't operational as that's a permanent on-demand course we offer. Good luck!

    • @sukeshsuvarna3355
      @sukeshsuvarna3355 10 днів тому

      @@LesterMartinATL Sure, Thank you!

  • @jkow80
    @jkow80 26 днів тому

    How do you tighten the middle faucet part? Mine is loose

    • @LesterMartinATL
      @LesterMartinATL 18 днів тому

      don't know that one, but let us know if you figure it out, please

  • @deanheld
    @deanheld Місяць тому

    would hvae been nice to show mu lt would have been nice to show table masking where the cntry code is in a user table and the blood type was in a labs table,

  • @StreetGrandTour
    @StreetGrandTour Місяць тому

    Thank you sir!!

  • @arlingtontrains7
    @arlingtontrains7 Місяць тому

    Thanks for the help

  • @patrickmorrissey2271
    @patrickmorrissey2271 Місяць тому

    Great job Sir! I would never have guessed to unplug and re plug the unit.... Also, my instructional pdf said nothing about the "3 button presses" sequence you showed..... Great job on that. I was able to fix my Mom's opener with zero cost.... Thank you Sir....

  • @justinpulu3984
    @justinpulu3984 Місяць тому

    Brother! You saved me. Thank you!

  • @AnthonyFiorica
    @AnthonyFiorica 2 місяці тому

    Thanks for the tip Lester. Such an easy fix.

  • @Valen-DP1
    @Valen-DP1 2 місяці тому

    have this same setup and this helped. thank you

  • @chobblegobbler6671
    @chobblegobbler6671 2 місяці тому

    Starburst vs dremio??

    • @LesterMartinATL
      @LesterMartinATL 2 місяці тому

      Probably Delta Lake vs Iceberg is the more appropriate comparison, but I'm thinking DBX has stop pushing Z-Ordering so hard any more. RE: Starburst vs Dremio... well, I used to be a trainer and developer advocate there so I just MIGHT be biased... I'd say Starburst (and Trino). :)

  • @jacobschofield9202
    @jacobschofield9202 2 місяці тому

    THANK YOU! I was thinking I’d have to take the whole thing off. Whew!

  • @rwdesperado2286
    @rwdesperado2286 2 місяці тому

    I started off just the same as you but I found your video on the first try! Thank You!

  • @amamdani15
    @amamdani15 2 місяці тому

    Wow, that was so easy. Thanks!

  • @EricT11425
    @EricT11425 2 місяці тому

    I was crawling underneath then can across this video and done I. 30 seconds

  • @ksm9385
    @ksm9385 2 місяці тому

    Looks great! I’m going to try this! Thank you so much for this concise solution

  • @sgstyle65
    @sgstyle65 3 місяці тому

    Was just able to fix my Hot Handle thanks to your video! It’s been sitting like that for a week and took me 5 secs to fix. I appreciate you so much! Thank you!

  • @karolbakiera9570
    @karolbakiera9570 3 місяці тому

    Great job man!

  • @brandong8978
    @brandong8978 3 місяці тому

    thanks

  • @lorendsalazar
    @lorendsalazar 3 місяці тому

    Thank you for your kind help. .

  • @Allan-et5ig
    @Allan-et5ig 3 місяці тому

    Lester Martin thanks a lot - your instructions worked, the mfg. video did not.

  • @pioneercolonel
    @pioneercolonel 3 місяці тому

    I totally confirm that unplugging is the key. Thanks man.

    • @LesterMartinATL
      @LesterMartinATL 3 місяці тому

      I know, right? Simple but brilliant!

    • @pioneercolonel
      @pioneercolonel 3 місяці тому

      @@LesterMartinATL right. I owe you a beer :)

  • @raulbriseno5502
    @raulbriseno5502 3 місяці тому

    The most useful video, for me anyways, in the history of UA-cam.

    • @LesterMartinATL
      @LesterMartinATL 3 місяці тому

      Wow, thanks for that compliment, that's amazing! Too bad my actual job-related videos (software developer) could be as helpful to as many as this video has! Again, thanks for the kind words. <3

  • @bfkirk
    @bfkirk 4 місяці тому

    Helped somebody today. Thank you!

  • @toddwiles7096
    @toddwiles7096 4 місяці тому

    This is awesome! thanks for posting this. You just saved me a ton of time...

  • @Samstraysongs
    @Samstraysongs 5 місяців тому

    Many thanks you really helped this 84 year old dude still learning HOW?

  • @brucehessenthaler3173
    @brucehessenthaler3173 5 місяців тому

    You're da boss man! Thanks so much. I thought it would be a simple pry the top and tighten and before I gouged the top or my hand etc, I decided to do a little search and behold, the enlightened answer :-)

    • @LesterMartinATL
      @LesterMartinATL 5 місяців тому

      Yes! It really hurts when the flat-head screwdriver slides off that little edge and slams into your hand! I'm so glad you got it working now!!

  • @Nvent1
    @Nvent1 5 місяців тому

    Thank you sir🎉🎉

  • @adityamasih9719
    @adityamasih9719 5 місяців тому

    I’m new to Apache Ranger. I’ve created an HDFS policy and configured it to store audit logs in Solr. When I create or delete directories in HDFS, the audit logs are generated and visible in the Ranger UI. However, when I perform operations as the superuser (hdfs), no audit logs are generated. Does Ranger not support audit logging for superuser actions? I have already checked all the configs and there are no exclusions to any user.

    • @LesterMartinATL
      @LesterMartinATL 5 місяців тому

      NGL... been about 3 years since I left Cloudera and I'm not really sure any more. Hopefully one of my Hadoop buddies can weigh in on that one.

  • @robot9122
    @robot9122 5 місяців тому

    cool

  • @lawrencethal1387
    @lawrencethal1387 6 місяців тому

    Thanks so much for your video !! I too would never have guessed they designed an upsidedown screw in there. I saw the threads and the bottom of the screw but didnt realize it was a bottom of a screw. Youve saved me days of frustration !!!

    • @LesterMartinATL
      @LesterMartinATL 5 місяців тому

      oh... there were more than a few days of frustration on my part! haha. i mostly put this up so I would remember how to do it again in the future. so awesome that it has helped so many!!

  • @PAKraig
    @PAKraig 6 місяців тому

    Thank you! Fixed my kitchen faucet tonight and your video was suggested below. Never even thought about how easy to fix my bathroom faucet could be too!

    • @LesterMartinATL
      @LesterMartinATL 6 місяців тому

      It is an amazingly weird design for sure!

  • @bccvtcorrea
    @bccvtcorrea 6 місяців тому

    Hey there, tks for all informations. Can you detail how sb, trino tables, views and materialized views works? for instance, one can create iceberg tables on starburst, what are the differences between querying those tables joining a view, materialized view and the underlying workers of datasources. tks

    • @LesterMartinATL
      @LesterMartinATL 6 місяців тому

      very very little differences at all; especially when doing a federated join on anything. check out my blog posts at lestermartin.blog/tag/iceberg/ and lestermartin.blog/tag/starburst/ for help with some of your questions.

  • @scottmattern482
    @scottmattern482 6 місяців тому

    Thank you

  • @jdudemoney
    @jdudemoney 6 місяців тому

    Thanks

  • @wesfloyd
    @wesfloyd 6 місяців тому

    Love the update! 👏👏

  • @ericmanion1161
    @ericmanion1161 6 місяців тому

    Right on brother! Good luck

  • @tbroas
    @tbroas 6 місяців тому

    Congrats Lester!

  • @leomiao5959
    @leomiao5959 7 місяців тому

    Thank you very much, this one is very informative and well structured. Easy to understand and touches on details. Thanks

  • @leomiao5959
    @leomiao5959 7 місяців тому

    Thank you, it's very informative

  • @abhijeetpurandare7142
    @abhijeetpurandare7142 7 місяців тому

    thanks for the detailed workshop @lester Martin

  • @JudyLowen
    @JudyLowen 7 місяців тому

    Does this tip work for widespread faucet handle too ? Have exact style in widespread style. Thanks for this !

    • @LesterMartinATL
      @LesterMartinATL 7 місяців тому

      I wish I knew @judylowen -- I'm not a plumber by any measure, but I knew when I finally got this figured out I needed to post it for others who were pulling their hair out like I was (and to remind me how to do it again in the future). GOOD LUCK!!

  • @paulnyberg8115
    @paulnyberg8115 7 місяців тому

    Thank you. Not the same faucet as I have, but enough info to figure it out.

  • @jrflyer9308
    @jrflyer9308 7 місяців тому

    Thank you. Perfect explanation! A five minute fix for an issue that had been bothering me for years.

  • @waldo19781
    @waldo19781 8 місяців тому

    thank you so much

  • @brettludden9810
    @brettludden9810 8 місяців тому

    Thank you! It does indeed feel too obvious now. I looked at it for months. I appreciate you, whoever you are.

    • @LesterMartinATL
      @LesterMartinATL 7 місяців тому

      YW; I'm just your Friendly Neighborhood Faucet-Man (ish). Glad it helped!!

  • @LindaFlynn321
    @LindaFlynn321 8 місяців тому

    I love you thank you