posts on Shadowsong's Personal Website

AI Log 1: Claude vs GPT — A Head-to-Head Agent Delegation Experiment

Fri, 01 May 2026 00:00:00 +0000

I pitted Claude Opus 4.7 via Bedrock API against GPT 5.5 — not as chatbots, but as agentic supervisors. Each was given the same task: write a delegation prompt for a coding agent, dispatch it, review the result, and iterate to correctness. Same codebase. Same delegate model. Same constraints. Only the parent agent changed.

RT Log 8: 5 Vibe Coding techniques

Wed, 09 Jul 2025 00:00:00 +0000

This article talks about several techniques I used when I code. It is not meant for direct adoption by readers because we might be writing different types of code. I was focusing mostly on Data Engineering and Software engineering (backend) code. If you were a data scientist, take this with a pinch of salt.

DE Log 9: Extend duckdb beyond the single player mode, by just a little bit

Sat, 28 Dec 2024 00:00:00 +0000

Yet another take on poor man’s lakehouse / or how to NOT contribute to Databricks’ IPO success even though it seems inevitable.

RT Log 7: 关于Chatgpt和学习

Sun, 30 Apr 2023 00:00:00 +0000

最近用chatgpt越来越频繁，感触良多。这里简单聊一下最近的一些感想，尤其是在自我学习上的一些辅助作用，如果能给予读者一些启示那再好不过了。

DET Log 1: A first “byte” of Airbyte

Fri, 21 Oct 2022 00:00:00 +0000

In this article, I am sharing my first impression on the open-sourced almighty data ingestion tool - Airbyte.

RT Log 6: Career summary v3

Thu, 17 Feb 2022 00:00:00 +0000

刚在看冬奥女子花滑决赛，特鲁索娃太过分了这么多四周跳，不过妹子长大了之后感觉没有原来轻盈了。结果看到有人在询问第三份总结的事情，想了想自从上次跳槽过了快半年了，也差不多是时候写一下新的总结。

DE Log 8: Thoughts on Data Engineering Specialisations

Sat, 01 Jan 2022 00:00:00 +0000

Happy New Year everyone! And I am too lazy to change the thumbnail image.

Book Log 3: 《文明的滴定》与个人科学史观

Mon, 13 Sep 2021 00:00:00 +0000

这本书是我偶然看一本历史穿越小说得知的，通过这本小说我知道了谁是苏颂，谁是韩公廉，沈括除了写《梦溪笔谈》还具体干了啥，也知道了在几百一千年前的中国历史中一些神奇的发明。作为完成了九年义务教育的我来说，谈及开封只悉晓清明上河图，古代科技只认四大发明，这在现在看来无疑是可笑的。

A guide to transfer securities from Saxo To Interactive Brokers

Tue, 31 Aug 2021 00:00:00 +0000

I have been using SAXO for three years and Interactive Brokers for more than one year, and recently I have decided to switch from SAXO to IB completely, but I could not find a proper instruction on the Internet.

RT Log 5: 关于Mac系统中文打字卡顿问题

Fri, 13 Aug 2021 00:00:00 +0000

这个问题说实话有点烦。

DE Log 7: Migrating from Airflow 1 to 2

Thu, 29 Apr 2021 00:00:00 +0000

Today I have successfully migrated my current Airflow setup from v1.10.14 to v2.0.2. This article will not be a very detailed step by step guide for upgrading, instead I will introduce the general migration step worked very specifically for my setup, and share some of the problems I encountered during the process, and finally some general feelings with Airflow 2.

DE Log 6: From Data Engineering to Meta Data Engineering - the future of Data Engineering

Wed, 19 Aug 2020 00:00:00 +0000

Data engineering jobs are really popular nowadays, mostly contributed by the rising demand of data insights and data driven decision making.

RT Log 4: About Starcraft 2

Thu, 13 Aug 2020 00:00:00 +0000

I just reached Diamond 3 on American server in Starcraft 2. Yeah yeah I know NA server is easier compared to Asian but it is still a diamond, and I am pretty happy. For this particular season I have not played a single game of cheese, but I have, sadly to say, counter cheesed opponents. Most of my games are played with heavy reliance on macro.

Music Log 2: About music practices and flat fingerings

Mon, 10 Aug 2020 00:00:00 +0000

So I am trying out Notion, so far it looks ok. With all the fancy templates it looks like it can do much more than Bear, but I have also heard rumors about how it can get pretty messy after you have a lot of stuff. It’s free for personal use anyway so I thought I want to give it a try, at least the table structure is pretty useful for me.

Music Log 1: About my recent obsession with Chopin Etude Op.10 No.1

Sat, 25 Jul 2020 00:00:00 +0000

So this week I was pretty serious in my piano practices, played for one hour everyday except on Friday, it has become an important part of my daily routine.

Movie Log 5: Knives Out

Thu, 09 Jul 2020 00:00:00 +0000

I have been on some sort of movie spree for a few nights in a row, without dropping my piano practices of course, and I ran into this movie called Knives Out a few hours ago.

DA Log 1: A Quick Introduction to Data Analysis

Wed, 13 May 2020 00:00:00 +0000

This is a bold title I know, and I am not even a data analyst.

RT Log 3: 又一个工作总结

Tue, 05 May 2020 00:00:00 +0000

还有不到两周的时间就要换工作了，时隔两年再打算写一个总结。

Movie Log 4: The Day After Tomorrow

Sun, 19 Apr 2020 00:00:00 +0000

估摸着约是我初二那年，也就是二零零八年，本来跟往常一样趁爸妈不在家准备偷偷玩电脑，结果误打误撞开始看电影，那也是我第一次在电脑上看电影，看的就是《后天》。记得在那之前，电影对我来说只是偶尔学校组织去厂放映厅看一些红色电影，多动症的年纪自然是无法沉浸其中。

DevOps Log 2: Setup Fargate Service without Public IP

Sat, 07 Mar 2020 00:00:00 +0000

This article will describe the process to setup Fargate tasks with only private IP, using images stored in a private registry.

RT Log 2: About Wuhan Virus

Wed, 22 Jan 2020 00:00:00 +0000

The battle against the fearful death himself is an everlasting one, and today we are, after seventeen years, effortless watching another heavy strike laid upon us. Well, to be more specific, mostly the people lived in China and who had been to China during this unfortunate period.

DE Log 5: Thoughts on Analytical Tables

Thu, 09 Jan 2020 00:00:00 +0000

I have taken some Database design course back in university days, though I have skipped almost all of the lectures as I was also self-learning during my first internship on the same matter, in a much more practical manner. I did not even know the word OLAP back then. However, I am not dismissing the importance of data modelling in data engineering. On the contrary, data modelling is one of the important skills if you want to be a data engineer.

DE Log 4: ETL vs ELT

Wed, 01 Jan 2020 00:00:00 +0000

We have all heard of the term ETL. If you are working in the data field, you might have been asked to do some sort of ETL work regardless of your actual job description.

Customize Terminal and IDE

Sat, 14 Dec 2019 00:00:00 +0000

This short article aims to reproduce my current workbench, using color plattes of my choice.

Book Log 2:《房思琪的初恋乐园》- 文学成瘾

Sat, 16 Nov 2019 00:00:00 +0000

我读完此书，顿时对作者的职业素养肃然起敬。作为一个青年作家，日日夜夜重现着一段承载了自己最痛苦的记忆，是多么煎熬的一件事。小说的质量，或许有一些地方还显稚嫩，但我觉得这是十分值得尊敬的，并不由于她的遭遇，而是哪怕在这种情况下，她依然能追随心中对文学的坚持，或者用她自己的话说，“对语言最下等的迷恋”。

DE Log 3: Amazon Redshift disk space saving tips

Mon, 04 Nov 2019 00:00:00 +0000

Recently Amazon Redshift launched a new console interface, which is pretty nice. It actually gives some valuable optimisation tips. A data warehouse is like a sword, you need to constantly sharpen it so it won’t lose its edge.

RT Log 1: About Automation

Wed, 23 Oct 2019 00:00:00 +0000

I will have some random thoughts here and there. This is a new series of logs, which will be short.

DE Log 2.1: Develop Data Science Project in Production

Thu, 17 Oct 2019 00:00:00 +0000

Recently I was working on the deployment of a predictive model built by my dear friend valued ex-colleague. Here I will share some thoughts and challenges I have encountered during its production deployment.

Movie Log 3 - Ad Astra

Fri, 27 Sep 2019 00:00:00 +0000

刚看了《Ad Adstra》回来，趁热还是把想法写一下，不然等过个几个小时我可能就懒得写了。 (结果还是晚了一天发哈哈)

DE Log 1: Idempotency

Sat, 31 Aug 2019 00:00:00 +0000

In linear algebra, an idempotent matrix is a matrix which, when multiplied by itself, yields itself.

Dramas Checklist

Sat, 24 Aug 2019 00:00:00 +0000

A list of TV series I would like to watch / have watched, and a short comments on them, by category.

DevOps Log 1: Setup DataDog and APM in AWS Fargate

Tue, 16 Jul 2019 00:00:00 +0000

Recently I am migrating some microservices and streaming pipelines to AWS Fargate. This article mainly covers the issues, pitfalls and other useful notes when I was deploying a web backend with DataDog.

Build Hugo Blog on Github Pages Master Branch

Tue, 11 Jun 2019 00:00:00 +0000

This short article aims to address issues I encountered during hosting personal static blog on Github Page.

DevOps Log 0.1: Setup Cloudwatch on EC2 Instance

Thu, 28 Mar 2019 00:00:00 +0000

I wrote this initially in our internal documentation website, so this is a very short note on how to setup Cloudwatch on AWS EC2.

Movie Log 2 - From Admiration to Sympathy - The Great Gatsby

Mon, 07 Jan 2019 00:00:00 +0000

I had watched this movie some years ago in the cinema, together with my friends. We learned one phrase that day - “Old sport”.

DE Log 0.1: Rescheduling of Airflow DAGs

Sat, 22 Sep 2018 00:00:00 +0000

This article briefly records the step to reschedule a DAG on Apache Airflow

Book Log 1: 重温《芳华》

Tue, 17 Jul 2018 00:00:00 +0000

这几天读书时间不太固定，心情也比较浮躁，生活中事情也比较多。觉得《芳华》这本书的厚度也比较好欺负，所以最终还是一头扎进了那个年代的想象。其实本来只想写一个朋友圈的，但是觉得，反正也闲着这段时间，多写点东西也是好的，至少能动一下脑子。

Movie Log 1 - Annihilation

Mon, 11 Jun 2018 00:00:00 +0000

本来我想着明早起来再写这篇文章，不过我感觉到那时候可能就忘的差不多了。还是趁热写吧，这倒不能算影评，只能算是感想了（应该还没有到写影评的水平）。

Drama Thoughts - Bull

Mon, 04 Jun 2018 00:00:00 +0000

Bull is an American drama television series starring Michael Weatherly. CBS ordered the program to series on May 13, 2016, and it premiered on September 20, 2016. The show is based on the early days of talk show host Dr. Phil McGraw’s career, when he was a trial consultant. ——— Wikipedia

Yes I am lazy I know.